From f294e3d959ed52c964d37ce18d63b059937167f1 Mon Sep 17 00:00:00 2001 From: yiranyyu <2606375857@qq.com> Date: Thu, 23 May 2024 18:29:05 +0800 Subject: [PATCH] update --- docs/compare_with_phi-3_vision.md | 8 ++++---- 1 file changed, 4 insertions(+), 4 deletions(-) diff --git a/docs/compare_with_phi-3_vision.md b/docs/compare_with_phi-3_vision.md index 9238b5f..5611e33 100644 --- a/docs/compare_with_phi-3_vision.md +++ b/docs/compare_with_phi-3_vision.md @@ -25,8 +25,8 @@ In most benchmarks, MiniCPM-Llama3-V 2.5 achieves **better performance** compare | | Phi-3-vision-128K-Instruct | MiniCPM-Llama3-V 2.5| |:-|:----------:|:-------------------:| | Size(参数) | **4B** | 8B| -| First Token Latency(首token延迟)$^1$ | L: 330ms, M: 330ms, H: 330ms | **L: 48ms, M: 145ms, H: 278ms** | -| Throughtput(吞吐率)$^2$| 30 tokens/s | **41 tokens/s**| +| First Token Latency(首token延迟)2 | L: 330ms, M: 330ms, H: 330ms | **L: 48ms, M: 145ms, H: 278ms** | +| Throughtput(吞吐率)2| 30 tokens/s | **41 tokens/s**| | OpenCompass 2024/05 | 53.7 | **58.8** | | OCRBench | 639.0 | **725.0**| | RealworldQA | 58.8 | **63.5**| @@ -41,7 +41,7 @@ In most benchmarks, MiniCPM-Llama3-V 2.5 achieves **better performance** compare 1: L(ow): 448pxl, M(edium): 896pxl, H(igh): 1344pxl input images.
-2. Evaluation environment: A800 GPU, flash-attn=2.4.3, batch-size=1. +1. Evaluation environment: A800 GPU, flash-attn=2.4.3, batch-size=1.
@@ -53,7 +53,7 @@ MiniCPM-Llama3-V 2.5 exhibits **stronger multilingual** capabilities compared wi MiniCPM-Llama3-V 2.5 在对话和推理评测榜单 LLaVA Bench 上展现出了比 Phi-3-vision-128K-Instruct **更强的多语言的性能**。
- +
Evaluation results of LLaVABench in multiple languages