MARCH: Three Agents for Grounded Self-Checking in RAG

Paper: 2603.24579 Authors: Zhuo Li, Yupeng Zhang, Pengyu Cheng, Jiajun Song, Mengyu Zhou, Hao Li, Shujie Hu, Yu Qin, Erchao Zhao, Xiaoxi Jiang, Guanjun Jiang Categories: cs.CL

The Gap

RAG is supposed to make language models factual by grounding them in retrieved documents, but in practice it often just gives models more material to misread. Current hallucination mitigation usually relies on one of two weak options. Either you supervise the final answer with coarse labels, which misses claim-level errors, or you ask another LLM to judge the answer while showing it the original response, which creates confirmation bias: the verifier sees the answer first and tends to rationalize it instead of independently checking the evidence.

That leaves a real hole. We have many evaluation tools for hallucination, but far fewer training frameworks that force the model to internally learn document-grounded checking. MARCH attacks exactly that hole by making self-verification asymmetric rather than self-referential.

Problem: RAG answers still hallucinate
         even with retrieved evidence
                |
                v
Existing fix 1: coarse answer-level supervision
Existing fix 2: LLM-as-judge sees full answer
                |
                v
Failure mode: claim-level errors survive,
              verifier inherits confirmation bias
                |
                v
Need: a training loop where verification is
      independent, granular, and grounded
                |
                v
MARCH: split generation, claim extraction,
       and blinded checking across 3 agents
                |
                v
Result: lower hallucination rates and better
        multi-hop QA from the same 8B base

The Increment

One sentence: Before MARCH, self-checking usually meant letting the model inspect its own answer; after MARCH, self-checking becomes a structured three-agent game where the verifier is deliberately blinded and the whole pipeline is optimized with reinforcement learning.

Core Mechanism

MARCH assigns three roles to the same base policy under different prompts.

1. Solver reads the query and retrieved documents, then writes the answer.
2. Proposer turns that answer into atomic question-answer pairs, effectively breaking the narrative into verifiable factual claims.
3. Checker receives only the atomic questions and the source documents, not the Solver’s original answer, and must answer each question from evidence alone.

The key idea is information asymmetry. The Checker is not allowed to see the Solver’s wording, so it cannot lazily agree with it. If the Proposer extracts a claim like “the company reported 14.2% growth in 2023,” the Checker must recover that answer from the documents independently. Any mismatch means the whole response trajectory is treated as flawed.

The reward is intentionally harsh. MARCH uses a Zero-Tolerance Reward: if every claim matches the Checker’s evidence-grounded answer, the trajectory gets success; if even one claim fails, the trajectory gets penalized. The authors then optimize both the Solver and Checker trajectories jointly with PPO, so the model learns not just to sound plausible, but to generate statements it can later survive under blind audit.

Query + retrieved docs
        |
        v
     [Solver]
        |
        | full response y
        v
    [Proposer]
        |
        | atomic QA pairs (qi, ai)
        v
     [Checker]
        |
        | answers âi using docs only
        | (no access to y)
        v
Compare ai vs âi
        |
        +-- all match --> reward
        |
        +-- one mismatch --> penalty

Think of it like writing, fact extraction, and legal review split across three desks. The writer drafts the memo, the analyst turns it into checkable statements, and the auditor verifies those statements using only the source folder, not the memo itself. That workflow is slower than just rereading the draft, but much better at catching wishful interpretation. MARCH turns that workflow into an RL training signal.

Key Concepts

• Information Asymmetry: This is the paper’s central move. Most LLM judges fail because they are exposed to too much of the original answer and get nudged toward agreement. MARCH removes that shortcut. The Checker sees the documents and the questions, but not the answer being checked.

• Claim-Level Atomization: Instead of scoring the final response as a single blob, MARCH decomposes it into atomic QA pairs. That gives the training loop finer supervision. A long answer may be mostly right but still contain one crucial wrong number; atomization makes that visible.

• Zero-Tolerance Reward: The reward is binary and unforgiving. One unsupported claim invalidates the whole response. This matters because partial-credit rewards can let models trade factual rigor for fluent-but-sloppy generation. MARCH explicitly rejects that tradeoff.

• Joint Optimization of Generation and Audit: The framework does not only train the Solver. It also trains the Checker trajectory, so the base model co-evolves as both a generator and an auditor. The paper argues that this dual role is what makes the grounding skill transferable to downstream QA.

Framework Shift

Before:
[Generate answer] -> [Judge sees answer + docs] -> [score]

After MARCH:
[Generate answer]
      |
      v
[Decompose into atomic claims]
      |
      v
[Blinded checker re-answers from docs only]
      |
      v
[Use claim agreement as RL reward]

One sentence: The shift is from answer-level self-evaluation with leaked context to claim-level blind auditing with reinforcement learning.

Expert Assessment

Problem choice: Strong. Hallucination in RAG is one of the few failure modes that directly blocks real deployment in law, finance, and healthcare. The paper targets a bottleneck that matters operationally, not just benchmark-wise.

Method maturity: Thoughtful and better engineered than it first appears. The three-agent design is conceptually simple, but the important contribution is not “more agents”—it is the asymmetric information structure plus the claim-level interface between them. That makes the method easier to trust than a vague self-critique loop. The downside is cost: generation, decomposition, and checking all sit in the training path, so this is not a lightweight trick.

Experimental integrity: Good overall. The paper evaluates on RAGTruth, FaithBench, Facts Grounding, ContextualJudgeBench, and multi-hop QA, which is a better spread than many factuality papers. The headline numbers are meaningful: on RAGTruth + FaithBench average accuracy, the base Llama3.1-8B rises from 55.20 to 74.93 with MARCH-STEM and 75.23 with MARCH-General; on Facts Grounding, it rises from 57.09 to 85.23; on ContextualJudgeBench average, it goes from 29.7 to 51.6/52.3. Those are not cosmetic gains.

What I buy most: The fact that better hallucination control also improves multi-hop QA is the paper’s strongest signal. MARCH is not merely building a stricter judge; it seems to be teaching the underlying policy to generate reasoning that remains anchored to evidence. That is a stronger claim, and the HotpotQA / MuSiQue / 2Wiki results support it.

What still worries me: The method leans heavily on factual decomposition into atomic claims, especially numerical or high-fidelity statements. That is a good fit for data-intensive RAG, but less obviously for open-ended explanation, synthesis, or creative knowledge work where claim boundaries are fuzzy. There is also an incentive question: zero-tolerance reward may suppress useful but harder-to-verify detail, pushing the model toward conservative answers.

Verdict: accept — The paper identifies a real failure mode, proposes a clean structural fix, and backs it with broad empirical gains. Even if the full training recipe is expensive, the design principle is important and likely to transfer.

Takeaways

Blind the verifier on purpose: If your verifier sees the answer it is supposed to check, you have already contaminated the audit. MARCH’s best idea is not the multi-agent framing by itself, but the discipline of removing answer leakage from the checking step.

Turn free-form answers into checkable interfaces: The Proposer is basically a compiler from narrative text to atomic QA pairs. That pattern is reusable well beyond this paper. If you want grounded generation, build an intermediate representation that can be independently validated.

Use harsher rewards when factuality is non-negotiable: In domains where one wrong number breaks trust, partial-credit reward functions may optimize the wrong thing. MARCH’s zero-tolerance setup is a reminder that the reward should match the operational failure standard, not just average benchmark convenience.