Gemma-3-12B-IT

Google8K context2025-03-12
Overall Rank
—
IDP benchmark pending
Overall Score
—
requires all benchmarks
Best Task
Text Extraction
52.4
Weakest Task
Key Information Extraction
0.0
Benchmark Performance
OlmOCR Benchv1.0
18/18
| Overall | Math | Table | Present | Absent | Order |
|---|---|---|---|---|---|
| 20.6 | 10.0 | 34.7 | 14.6 | 67.9 | 7.7 |
OmniDocBenchv1.5
16/18
| Overall | Text Edit↓ | CDM↑ | TEDS↑ | TEDS-S↑ | Read Order↓ |
|---|---|---|---|---|---|
| 44.6 | 0.476 | 50.0 | 31.6 | 46.9 | 0.364 |
IDP Core Benchv1.0
17/18
| Overall | KIE | OCR | Table | VQA |
|---|---|---|---|---|
| 0.0 | 0.0 | 0.0 | 0.0 | 0.0 |
Capability Profile
Strength Analysis
Auto-generated from benchmark scores
Strengths
- Text Extraction52.4
- Formula50.0
Weaknesses
- Key Information Extraction0.0
- Visual QA0.0