OmniVerifier-M1: Teaching Multimodal Models to Show Their Work with Symbolic Verification

Paper: 2605.28805 Authors: Xinchen Zhang, Bowei Liu, Jiale Liu, Chufan Shi, Yizhen Zhang, Junhong Liu, Youliang Zhang, Zhiheng Li, Yujiu Yang, Ling Yang Categories: cs.CL, cs.AI, cs.CV, cs.LG

The Gap

Multimodal LLMs generate visual outputs (images, layouts, spatial reasoning), but existing verifiers only say “right” or “wrong” without explaining where errors occur. Process supervision methods from text domains use natural language rationales, but these are vague for spatial tasks. You can’t fix “the object is slightly misplaced” without coordinates. Prior work either relies on expensive auxiliary judge models to score textual explanations, or trains verifiers end-to-end without interpretable intermediate reasoning.

Problem: Verifiers give binary signals, no spatial error localization
   |
   v
Assumption: Symbolic outputs (bounding boxes) > text for spatial tasks
   |
   v
Method: Train verifier to output boxes + decouple RL for judgment/localization
   |
   v
Evidence: Symbolic rationales enable rule-based rewards, outperform text
   |
   v
Conclusion: Verifier-driven agentic system achieves region-level self-correction

The Increment

One sentence: Before, multimodal verifiers were black-box classifiers; after, they output structured spatial rationales that enable automated error correction.

Core Mechanism

OmniVerifier-M1 is a vision-language model trained to perform two tasks simultaneously: (1) binary judgment (is this output correct?), and (2) meta-verification (where exactly is the error?). The key architectural choice is outputting bounding boxes instead of text explanations for spatial errors.

Training uses a two-stage process. First, supervised fine-tuning on labeled data where correct outputs get empty boxes and incorrect outputs get boxes around error regions. Second, reinforcement learning with decoupled objectives: one reward signal for judgment accuracy, a separate signal for box quality. Box quality is measured by rule-based metrics (IoU with ground truth error regions), avoiding the need for a separate judge model.

The verifier feeds into M1-TTS, an agentic generation system. When the verifier flags an error and provides a bounding box, the generator crops that region, regenerates it, and pastes it back. This loop continues until the verifier approves or a budget is exhausted.

Input Image + Generated Output
         |
         v
    [Verifier]
    /        \
   /          \
Judgment    Bounding Box
(binary)    (x,y,w,h)
   |            |
   v            v
Accept      Crop Region
            Regenerate
            Paste Back
               |
               v
          [Loop until OK]

Think of it like a photo editor with a built-in quality inspector. The inspector doesn’t just reject bad photos—it circles the problem areas with a red marker. The editor then knows exactly which regions to retouch. The inspector has two separate skill sets: recognizing overall quality (judgment) and precisely marking defects (localization). Training these skills separately is like teaching someone to grade essays and to annotate grammar errors as distinct competencies, rather than forcing them to learn both simultaneously.

Key Concepts

• Meta-verification: Instead of just outputting “correct” or “incorrect,” the verifier explains its reasoning. In text domains, this might be a natural language explanation. In visual domains, this paper argues structured outputs (bounding boxes) are more useful because they’re unambiguous and actionable. A box at coordinates (100, 150, 50, 50) tells you exactly where the problem is; “the object is too far left” does not.

• Decoupled reinforcement learning: Training a model to do two things at once (judgment + localization) with a single reward signal creates conflicts. Judgment rewards are sparse (right/wrong), while localization rewards are dense (IoU scores). Judgment needs to learn conservative decision boundaries, while localization needs to learn precise spatial regression. Decoupling means: optimize judgment with one loss function, optimize localization with another, even though they share the same model backbone. It’s like training a chess player on tactics puzzles and endgame studies separately, rather than only playing full games.

• Rule-based rewards for symbolic outputs: When your verifier outputs bounding boxes, you can compute reward directly by comparing predicted boxes to ground truth boxes (IoU, precision, recall). No need for a separate “judge model” to score the quality of explanations. This is only possible because boxes are structured and comparable; you can’t do this with free-form text explanations without introducing another model to evaluate them.

Framework Shift

Before (mainstream approach):        After (this paper):

Generator --> [Verifier]             Generator --> [Verifier]
                  |                                /        \
                  v                               /          \
            Accept/Reject                    Judgment    Bounding Box
                                                 |            |
                                                 v            v
                                             Accept      Crop + Regen
                                                             |
                                                             v
                                                        [Loop]

Verifier = black box classifier      Verifier = structured reasoner
Feedback = binary signal             Feedback = spatial coordinates

From opaque judgment to transparent localization, the core shift is making verification interpretable and actionable through structured symbolic outputs.

Expert Assessment

Problem choice: Real gap. As multimodal models generate more complex visual outputs (layouts, diagrams, spatial arrangements), the inability to localize errors becomes a bottleneck for iterative refinement. This is not a manufactured problem—it’s the natural next step after achieving decent generation quality.

Method maturity: The insight about symbolic outputs is clever and well-motivated. Decoupled RL is a known technique but applied thoughtfully here. However, the paper doesn’t explore failure modes: what happens when errors are diffuse (overall composition is wrong) rather than localized? Bounding boxes assume errors are region-specific. The reliance on ground truth error regions during training is also a limitation—how do you scale annotation for this?

Experimental integrity: Baselines are reasonable (verifiers without meta-verification, verifiers with textual rationales). The ablation on decoupled vs joint RL is convincing. However, the paper lacks comparison with simpler alternatives: what if you just trained a separate localization model instead of multi-tasking? The M1-TTS results show improvement, but no analysis of when the agentic loop helps vs when it wastes compute by over-correcting.

Writing quality: The abstract and introduction are clear. The method section buries the key insight (symbolic > textual rationales) under implementation details. The experimental section would benefit from error analysis: show examples where the verifier succeeds and fails, not just aggregate metrics. The related work section is perfunctory.

Verdict: weak accept — Solid contribution with a useful insight (structured outputs for spatial verification), but the scope is narrower than the paper claims (only works for localized errors) and the experimental analysis could be deeper.

Takeaways

Practitioners can steal the core idea: when building verifiers for structured outputs (code, layouts, diagrams), prefer structured feedback over natural language explanations. Structured feedback enables rule-based reward computation, avoiding the need for auxiliary judge models. This applies beyond vision: a code verifier could output line numbers and error types instead of prose explanations.

The decoupled RL technique is transferable: if your model has multiple objectives with different learning dynamics (sparse vs dense rewards, classification vs regression), train them with separate loss functions even if they share a backbone. Don’t force a single reward signal to balance competing objectives.

The agentic loop pattern (generate → verify → localize → regenerate) is a general recipe for iterative refinement, but only works if your verifier provides actionable feedback. If your verifier just says “bad,” you’re stuck. If it says “bad at coordinates (x, y),” you can fix it.