Datalab Releases OmniParseBench: An Open OCR Benchmark With 16,288 Pass/Fail Tests to Audit OCR Parsers

What happened

Datalab released OmniParseBench, an open OCR benchmark with 16,288 yes/no tests on 2,937 pages in 92 languages. Every score is a pass rate you can slice by tag, script or language.

It scores parsers with 16,288 yes/no tests on 2,937 pages from 2,343 documents. Datalab sells a parser, and its own top setting, Datalab accurate, ranks second on the launch leaderboard, behind Gemini 3.8 Flash.

OmniParseBench is an evaluation harness, not a model. It installs with uv pip install omni-parse-bench, needs Python 3.11+, and scores outputs offline with no API (the interface one piece of software uses to talk to another) keys.

Key facts

• Datalab — released: OmniParseBench, an open OCR benchmark with 16,288 yes/no tests on 2,937 pages in 92 languages