Open Source8B
Ministral-8B
Mistral AI131K context2024-10-16
Overall Rank
#10
of 16 models
Overall Score
68.0
avg across benchmarks
Best Task
Key Information Extraction
85.7
Weakest Task
Visual QA
57.4
Benchmark Performance
OlmOCR Benchv1.0
9/16
| Overall | Math | Table | Present | Absent | Order |
|---|---|---|---|---|---|
| 57.8 | 50.8 | 79.2 | 42.0 | 55.7 | 71.4 |
OmniDocBenchv1.5
11/16
| Overall | Text Edit↓ | Formula CDM↑ | Table TEDS↑ | TEDS-S↑ | Read Order↓ |
|---|---|---|---|---|---|
| 78.3 | 0.157 | 83.3 | 67.1 | 73.8 | 0.125 |
IDP Core Benchv1.0
10/16
| Overall | KIE | OCR | Table | VQA |
|---|---|---|---|---|
| 67.9 | 85.7 | 67.8 | 75.9 | 57.4 |
Capability Profile
Strength Analysis
Auto-generated from benchmark scores
Strengths
- Key Information Extraction85.7
- Text Extraction84.3
Weaknesses
- Visual QA57.4
- Table Understanding74.1