Agentar-Fin-OCR: Document Parsing for Financial PDFs with Cross-Page Continuity

Paper: 2603.11044 Authors: Siyi Qian, Xiongfei Bai, Bingtao Fu, Yichen Lu, Gaoyang Zhang, Xudong Yang, Peng Zhang Categories: cs.CV

The Gap

Existing document parsing systems treat PDFs as sequences of independent pages. This works fine for simple documents, but financial reports—think 200-page annual reports with tables spanning multiple pages, nested section hierarchies, and the need to trace every number back to its source cell—break this paradigm. Prior approaches like LayoutLM, Donut, and Nougat parse page-by-page, which means a table split across pages becomes two disconnected fragments. You lose the thread of “this row continues from the previous page” and “this section is a subsection of something 50 pages back.”

The core problem: page boundaries are typographic artifacts, not semantic ones. But most parsers treat them as hard walls.

Problem: Financial PDFs with cross-page structures
    |
    v
Assumption: Document-level context > page-level context
    |
    v
Method: Cross-page consolidation + global TOC tree + curriculum learning
    |
    v
Evidence: FinDocBench benchmark shows improved continuity metrics
    |
    v
Conclusion: Document-level parsing enables auditing-grade provenance

The Increment

One sentence: Before this paper, you got fragmented page-by-page outputs; after, you get a continuous document-level structure where tables and sections flow across page breaks.

Core Mechanism

The system has four main components working in sequence. First, a Cross-page Contents Consolidation algorithm scans for structural elements (tables, lists, sections) that are split across page boundaries and stitches them back together. Second, a Document-level Heading Hierarchy Reconstruction (DHR) module analyzes all headings across the entire document to build a global Table of Contents tree—not just “this page has these headings” but “heading 3.2.1 is nested under 3.2 which is under 3.”

Third, for table parsing specifically, they use difficulty-adaptive curriculum learning: train the model on simple tables first (few rows, clear borders), then gradually introduce harder cases (merged cells, no borders, complex layouts). Fourth, the CellBBoxRegressor module is the clever bit—instead of using an external object detector to find table cells, it uses structural anchor tokens embedded in the decoder’s hidden states. The decoder learns to emit special tokens that mark cell boundaries, and these tokens’ hidden states are used to regress bounding boxes directly.

Input PDF (200 pages)
    |
    v
[Cross-page Consolidation]  <-- Reconnects split tables/sections
    |
    v
[DHR Module]  <-- Builds global TOC tree
    |
    v
[Table Parser + Curriculum Learning]  <-- Easy -> Hard training
    |
    v
[CellBBoxRegressor]  <-- Anchor tokens -> bounding boxes
    |
    v
Structured Output (continuous, hierarchical)

Think of it like reassembling a book that was arbitrarily chopped into page-sized chunks and scattered. The cross-page consolidation is like finding pieces that clearly belong together—“this sentence ends mid-word on page 47 and continues on page 48.” The DHR module is like rebuilding the original table of contents by looking at all chapter and section markers across the entire book, not just within each chunk. The curriculum learning is like training a cataloger by starting with children’s books (simple structure) before moving to academic texts (complex nested sections). And the anchor tokens are like using the book’s own internal bookmarks (chapter markers, section dividers) to navigate, rather than needing an external GPS to tell you where each paragraph is.

Key Concepts

• Cross-page Consolidation: Imagine you’re reading a financial table, and the page ends mid-row. The next page starts with what looks like a continuation, but how do you know for sure? Cross-page consolidation uses heuristics—matching column structures, checking for continuation markers, analyzing whitespace patterns—to decide “yes, these two table fragments are actually one table.” It’s not just concatenation; it’s semantic stitching. Example: Page 47 ends with “Revenue | 2023 | $1.2M" and page 48 starts with "Revenue | 2024 |$1.5M”—same column structure, clearly a continuation.

• Document-level TOC Tree: Most parsers see headings locally: “this page has a heading that looks like level 2.” But is it 2.1 or 3.2 or 5.4? A document-level TOC tree tracks the entire hierarchy across all pages. It knows that “Risk Factors” on page 30 is section 3, and “Market Risk” on page 35 is subsection 3.1, and “Interest Rate Risk” on page 37 is 3.1.1. This enables structure-aware retrieval: “give me everything under section 3” means pages 30-50, not just page 30.

• Structural Anchor Tokens: Traditional table parsing uses an object detector to draw boxes around cells, then feeds those boxes to a model. Anchor tokens flip this: the decoder itself emits special tokens (like <cell_start>, <cell_end>) as it generates the table structure, and these tokens’ hidden states encode spatial information. You train a small regressor on top of these hidden states to predict bounding boxes. Why is this better? One less module to maintain, and the spatial information is grounded in the decoder’s understanding of table structure, not a separate vision model.

Framework Shift

Before (page-level):                After (document-level):

Page 1 -> Parse -> Output 1         Entire PDF
Page 2 -> Parse -> Output 2             |
Page 3 -> Parse -> Output 3             v
  ...                               [Build Global Context]
Page N -> Parse -> Output N             |
                                        v
(Fragments, no continuity)          [Parse with Continuity]
                                        |
                                        v
                                    Single Structured Output
                                    (Tables intact, TOC tree)

From isolated page processing to holistic document understanding, the core shift is treating page breaks as noise to be removed rather than natural boundaries to respect.

Expert Assessment

Problem choice: This is a real gap, not manufactured. Anyone who’s tried to extract data from a 300-page financial report knows the pain of tables split across pages. The “auditing-grade provenance” framing is smart—it’s not just about accuracy, but traceability, which matters in finance. The problem sits at the intersection of document AI and domain-specific needs, which is a productive space.

Method maturity: Mix of solid engineering (cross-page consolidation is mostly heuristics and rules) and ML innovation (anchor tokens, curriculum learning). The anchor token approach is genuinely clever—avoiding external detectors simplifies the pipeline. But I’m skeptical about how much the curriculum learning actually helps versus just training longer. The paper doesn’t ablate this clearly.

Experimental integrity: They created their own benchmark (FinDocBench), which is necessary for domain-specific evaluation but raises questions about generalization. The baselines include strong models (Nougat, Donut), but it’s unclear if those models were fine-tuned on financial documents or used zero-shot. The metrics (TocEDS, cross-page TEDS, C-IoU) are reasonable but custom, making it hard to compare to other work. I’d want to see results on a public benchmark too.

Writing quality: The abstract is acronym soup (DHR, TOC, TEDS, C-IoU) without enough motivation upfront. The paper would benefit from a clearer “here’s a real financial document and here’s what breaks” example in the intro. The method section is dense—probably could split the table parsing and document structure parts into separate sections for clarity.

Verdict: Weak accept — solid engineering work addressing a real problem with some clever ideas (anchor tokens), but the evaluation is limited to a custom benchmark and the writing could be clearer.

Takeaways

Curriculum learning for structured parsing: Start training on simple examples (clean tables, clear hierarchies) and gradually introduce complexity. This isn’t just for tables—you could apply it to any structured extraction task where examples vary widely in difficulty.

Decoder-based localization: Instead of using external object detectors, embed spatial information in the decoder’s hidden states via special tokens. This reduces pipeline complexity and grounds spatial understanding in semantic structure.

Document-level vs page-level processing: For any multi-page document task, ask: “Are page boundaries semantically meaningful?” If not, design your system to operate at document level, treating pages as an artifact to be abstracted away.

Domain-specific benchmarks: When existing benchmarks don’t capture your domain’s challenges (cross-page continuity, cell-level provenance), build your own. But make sure to also report on public benchmarks for comparability.