Open Source12B
Pixtral-12B
Mistral AI131K context2025-09-17
Overall Rank
#14
of 16 models
Overall Score
46.0
avg across benchmarks
Best Task
Key Information Extraction
76.2
Weakest Task
Text Extraction
35.9
Benchmark Performance
OlmOCR Benchv1.0
14/16
| Overall | Math | Table | Present | Absent | Order |
|---|---|---|---|---|---|
| 36.8 | 32.8 | 46.7 | 15.4 | 74.5 | 25.1 |
OmniDocBenchv1.5
16/16
| Overall | Text Edit↓ | Formula CDM↑ | Table TEDS↑ | TEDS-S↑ | Read Order↓ |
|---|---|---|---|---|---|
| 42.3 | 0.641 | 58.8 | 32.1 | 50.8 | 0.422 |
IDP Core Benchv1.0
12/16
| Overall | KIE | OCR | Table | VQA |
|---|---|---|---|---|
| 59.0 | 76.2 | 54.8 | 47.5 | 57.5 |
Capability Profile
Strength Analysis
Auto-generated from benchmark scores
Strengths
- Key Information Extraction76.2
- Formula58.8
Weaknesses
- Text Extraction35.9
- Layout & Order41.5