Datalab Marker v2 vs MinerU, Docling, and Liteparse: Benchmark Breakdown
Datalab released Marker v2, a complete rewrite of its open-source document conversion pipeline, integrating Surya OCR 2, a 20M-parameter layout model, and a rebuilt pdftext engine. In balanced mode on a single B200 GPU, Marker v2 achieves 76.0% accuracy on the olmOCR-bench with a throughput of 2.9 pages per second, significantly outperforming MinerU (0.54 pg/s) and Docling (2.1 pg/s). The architecture introduces three distinct modes: balanced (highest quality via VLM), fast (cost-effective via l
Analysis
TL;DR
- Datalab released Marker v2, a complete rewrite of its open-source document conversion pipeline, integrating Surya OCR 2, a 20M-parameter layout model, and a rebuilt pdftext engine.
- In balanced mode on a single B200 GPU, Marker v2 achieves 76.0% accuracy on the olmOCR-bench with a throughput of 2.9 pages per second, significantly outperforming MinerU (0.54 pg/s) and Docling (2.1 pg/s).
- The architecture introduces three distinct modes: balanced (highest quality via VLM), fast (cost-effective via lightweight detectors), and disable_ocr (pure CPU text extraction).
- Marker v2 demonstrates superior scalability by decoupling CPU workers from a shared Surya inference server, allowing throughput to scale with server capacity rather than per-process VRAM.
- While full-page VLMs like Chandra 2 still lead in raw accuracy for complex scans, Marker v2’s balanced mode rivals API-based solutions like Gemini Flash 3.5 for born-digital PDFs at a fraction of the latency and cost.
Why It Matters
This release establishes a new benchmark for high-throughput, high-fidelity document parsing, offering AI practitioners a viable alternative to expensive or slow proprietary APIs for processing large volumes of PDFs. The ability to achieve near-VLM accuracy with significantly higher throughput on consumer-grade hardware (or single GPUs) lowers the barrier for enterprise RAG systems that require precise structural understanding of documents. Furthermore, the clear trade-offs between accuracy and speed across different modes allow teams to optimize their pipelines based on specific use cases, such as batch processing versus real-time ingestion.
Technical Details
- Core Architecture: Marker v2 is built around three key components: Surya OCR 2 for optical character recognition, a 20M-parameter layout detection model for identifying columns, tables, and headers, and an optimized pdftext engine that is 3x faster than its predecessor.
- Conversion Modes: The tool offers three paths: "balanced" uses the Surya VLM for layout and re-OCR when embedded text is poor (76.0% score); "fast" uses a lightweight rf-detr/onnx detector with minimal VLM usage (66.6% score); and "disable_ocr" performs pure text-layer extraction on CPU (43.6% score, 23.7 pg/s).
- Benchmark Performance: Evaluated on Allen AI’s olmOCR-bench (1,403 PDFs, ~8,400 tests), Marker v2 balanced mode scored 76.0% overall and 83.5% on born-digital PDFs. It sustained 2.9 pages per second on a B200 GPU, compared to MinerU’s 0.54 pg/s and Docling’s 2.1 pg/s.
- Scalability Design: The system utilizes many thin CPU workers sharing a single Surya inference server. This architecture budgets VLM concurrency across workers, enabling throughput to scale with server capacity rather than being limited by per-process VRAM constraints.
- Compatibility & Changes: Requires Python 3.10+ and has shifted packaging from Poetry to uv/hatchling. Structured-extraction converters were removed, directing users to hosted APIs or LLM workflows for those features.
Industry Insight
- Hybrid Pipeline Adoption: Organizations should consider adopting hybrid strategies where "fast" or "disable_ocr" modes handle high-volume, simple documents, while "balanced" mode is reserved for complex, scanned, or math-heavy documents requiring high fidelity.
- Cost-Efficiency in RAG: The significant throughput advantage over competitors like MinerU suggests that self-hosted Marker v2 can drastically reduce infrastructure costs for RAG systems processing large document corpora, especially when leveraging CPU-only modes for less critical data.
- Benchmark Contextualization: While Marker v2 shows strong results, teams must validate these findings against their own specific document mixes, as performance varies significantly between born-digital PDFs and scanned images. The gap between pipeline-based tools and full-page VLMs remains relevant for edge cases involving complex layouts or poor-quality scans.
Disclaimer: The above content is generated by AI and is for reference only.