Papers
arxiv:2609.37712

PolyOCR-Venus: Unified OCR Foundation Models for Text-Centric Visual Intelligence

Published on Sep 29
· Submitted by
Changjiang Jiang
on Oct 12
Authors:
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,

Abstract

Optical Character Recognition (OCR) is evolving from plain-text transcription toward general visual intelligence, requiring models to recognize, localize, and reason over textual information in complex visual environments. However, existing OCR systems often excel at only some tasks and struggle to balance recognition, parsing, and reasoning across scenarios. In this report, we present PolyOCR, a family of unified OCR foundation models of varying scales. PolyOCR combines a shared instruction-following framework with a large-scale data engine that converts heterogeneous visual resources into quality-verified OCR supervision. We introduce Competence-Guided Policy Optimization, which combines verifier-based Group Relative Policy Optimization with on-policy distillation through sample-wise routing based on teacher reliability and the teacher--student competence gap. We also introduce OCRBench v2.1, our revision of OCRBench v2 with manually verified annotation corrections and task-aligned scoring metrics. Extensive experiments across OCRBench v2.1, CC-OCR, in-house KIE Benchmark, OmniDocBench v1.6 and MDPBench demonstrate that PolyOCR achieves state-of-the-art or highly competitive performance.

Community

Paper submitter

Meet PolyOCR-Venus, a family of OCR models for reading, locating, parsing, and reasoning over text in images. (。•̀ᴗ-)✧

🔍 A shared interface for diverse OCR tasks. The 2B and 9B models bring text recognition, grounding, document parsing, information extraction, and OCR reasoning into one instruction-following framework.

🧠 Learn from the teacher when its guidance helps. Our Competence-Guided Policy Optimization (CGPO) combines GRPO with on-policy distillation, adjusting teacher supervision per sample based on teacher reliability and the evolving teacher–student competence gap.

📊 Strong results at modest model sizes. PolyOCR-9B scores 80.42 / 78.37 on OCRBench v2.1 (English / Chinese) and 82.43 on CC-OCR across the three evaluated tracks, excluding multilingual OCR. A dedicated 2.7B multilingual variant reaches 87.0 on MDPBench.

🛠️ Evaluation gets attention too. OCRBench v2.1 revises 2,449 samples with manual verification and introduces task-aligned scoring for more reliable evaluation.

Sign up or log in to comment

Get this paper in your agent:

hf papers read 2609.37712
Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash

Models citing this paper 0

No model linking this paper

Cite arxiv.org/abs/2609.37712 in a model README.md to link it from this page.

Datasets citing this paper 0

No dataset linking this paper

Cite arxiv.org/abs/2609.37712 in a dataset README.md to link it from this page.

Spaces citing this paper 1

Collections including this paper 0

No Collection including this paper

Add this paper to a collection to link it from this page.