Perceptual Judgment Bias: Teaching Multimodal LLM Judges to Trust Their Eyes Over Plausible Text

Paper: 2606.02578 Authors: Seojeong Park, Jiho Choi, Junyong Kang, Seonho Lee, Jaeyo Shin, Hyunjung Shim Categories: cs.CV, cs.AI

The Gap

Multimodal LLMs can now serve as automated evaluators (MLLM-as-a-Judge), but they exhibit a systematic failure mode: when visual evidence contradicts textual content, they reward fluent explanations over perceptually correct answers. Existing work focuses on improving reasoning or alignment but doesn’t address this visual-textual anchoring bias. The evaluation becomes non-verifiable because the judge isn’t grounded in its own perception.

Problem: MLLM judge sees image A, candidate says "B" eloquently
   |
   v
Current behavior: Judge rewards eloquence, ignores visual mismatch
   |
   v
Root cause: Training lacks perceptual supervision signal
   |
   v
This paper's hypothesis: Controlled visual perturbations isolate bias
   |
   v
Method: Perturbed counterfactuals + GRPO reward + batch ranking
   |
   v
Evidence: Improved perceptual fidelity across 5 benchmarks
   |
   v
Conclusion: Judges can be trained to trust their vision first

The Increment

One sentence: Before this paper, multimodal judges prioritized narrative coherence over visual correctness; after, they can be systematically trained to anchor on perceptual evidence through counterfactual perturbations and structured reward modeling.

Core Mechanism

The method operates in three stages. First, it constructs the Perceptually Perturbed Judgment Dataset by taking existing multimodal QA instances and creating minimal edits to responses—changing a key visual detail while keeping everything else fluent. For example, if the correct answer is “red car,” the counterfactual becomes “blue car” with identical sentence structure. This isolates perceptual errors from reasoning failures.

Second, it trains a reward model using GRPO (Group Relative Policy Optimization) combined with a batch-ranking objective. Instead of requiring explicit pairwise labels, it uses the perturbed dataset to learn a scoring function where perceptually correct answers rank higher than fluent-but-wrong counterfactuals. The reward signal comes from verifiable visual grounding: did the judge’s score align with what’s actually in the image?

Third, the trained judge is deployed to evaluate new multimodal responses. During inference, it maintains coherent global ordering—if response A beats B and B beats C, then A beats C—because the batch-ranking loss enforced transitivity during training. The judge now weights visual evidence more heavily than textual plausibility.

Input: Image + Candidate Response
   |
   v
[Perceptual Encoder] -----> Visual features
   |                              |
   v                              v
[Text Encoder] -----> Text features
   |                              |
   +------------------------------+
   v
[Fusion + Reward Head]
   |
   v
Score: P(perceptually correct | image, text)
   |
   v
Training signal: GRPO reward + batch-rank loss
   ^
   |
Supervision: Perturbed counterfactual pairs

Think of this like training a wine judge who initially ranks bottles by label design rather than taste. You create a controlled experiment: swap the labels on identical wines and see if the judge notices. When they fail, you don’t just tell them “trust your palate”—you systematically train them by presenting batches where the only difference is the actual liquid, forcing them to anchor on sensory evidence. The perturbed dataset is the label-swap. The GRPO reward is the feedback loop saying “you ranked the wrong bottle higher.” The batch-ranking loss ensures if they learn Merlot > Pinot and Pinot > Chardonnay, they don’t then claim Chardonnay > Merlot in a different tasting session. After training, the judge reflexively checks the liquid before reading the label.

Key Concepts

• Perceptual Judgment Bias: When a multimodal model evaluates another model’s response, it should ground its judgment in visual evidence. Instead, current judges exhibit a systematic tendency to reward responses that sound plausible—correct vocabulary, fluent grammar, coherent narrative—even when those responses misidentify what’s visually present. Imagine a model sees a photo of a brown dog and evaluates two answers: “The animal is a brown dog” (correct) versus “The sleek black Labrador retrieves the frisbee gracefully” (wrong but eloquent). Biased judges score the second higher because the language is richer, not because it matches the image. This bias makes evaluations unreliable: you can’t verify a judgment that ignores the evidence it’s supposed to be based on. The paper systematically demonstrates this by showing judges flip their rankings when you make tiny visual edits that shouldn’t matter to a perceptually grounded evaluator.

• Counterfactual Perturbation for Verifiable Supervision: Training data for judges usually comes from human preferences, which are expensive and noisy. This paper generates training signal by creating minimal edits: take a correct response, change only the perceptual claim (red→blue, cat→dog), keep everything else identical. Now you have a verifiable pair: one is objectively correct per the image, one is objectively wrong, and the only difference is the perceptual content. This lets you train without ambiguous preference labels. It’s like creating a reading comprehension test where the only variable is whether the answer matches the passage—no need for subjective quality judgments. The perturbation isolates the perceptual dimension from stylistic or reasoning factors, giving you clean supervision for the specific bias you’re trying to fix.

• Batch-Ranking Coherence: Typical pairwise training treats each comparison independently: A vs B, then B vs C. But this allows incoherence—the model might say A>B, B>C, then C>A in different contexts. Batch-ranking looks at multiple responses simultaneously and enforces a global ordering: if the model ranks response i above j in one batch, it should maintain that ordering when they appear together later. The training loss penalizes violations of transitivity. Think of it as teaching the model to maintain a leaderboard rather than making isolated binary choices. This matters for judges because evaluation is comparative—users want to rank multiple model outputs—and incoherent rankings destroy trust. The paper achieves this without needing explicit N-choose-2 pairwise labels by using the batch structure itself as the supervision signal.

Framework Shift

Before (mainstream approach):        After (this paper):

Image + Response                     Image + Response
      |                                    |
      v                                    v
  [MLLM Judge]                      [Perceptual Encoder]
      |                                    |
Evaluate:                            Extract visual
"Does this sound right?"             features explicitly
      |                                    |
      v                                    v
High score for                       [Counterfactual
eloquent text                        Generator]
      |                                    |
      v                                    v
Non-verifiable                       Create red vs blue
ranking                              minimal pairs
                                           |
                                           v
                                     [Reward Model
                                      + Batch Rank]
                                           |
                                     Train: "Did you
                                     anchor on vision?"
                                           |
                                           v
                                     Verifiable, coherent
                                     perceptual grounding

From implicit multimodal reasoning to explicit perceptual supervision, the core shift is treating visual grounding as a trainable objective with verifiable ground truth rather than an emergent property of scale.

Expert Assessment

Problem choice: Real gap. Automated evaluation is a bottleneck for multimodal systems, and the observation that judges reward fluency over correctness is empirically documented. This isn’t manufactured—the paper runs controlled experiments showing state-of-the-art judges fail on trivial perturbations. The problem sits at a critical juncture: as we move toward LLM-based evaluation pipelines, perceptual reliability is infrastructure, not a nice-to-have.

Method maturity: Mix of clever and brute force. The counterfactual perturbation idea is elegant—minimal intervention to isolate the bias. But the reliance on GRPO + batch-ranking feels like stacking techniques rather than a unified insight. Are simpler approaches being overlooked? What if you just added perceptual contrastive loss during pretraining? The paper doesn’t explore lightweight alternatives. That said, the framework is modular and the components are individually justified.

Experimental integrity: Baselines are fair (GPT-4V, Mantis, existing reward models) and span diverse benchmarks (LLaVA-Bench, MMVet, etc.). The ablations clearly show which components matter. One red flag: the perturbed dataset construction relies on GPT-4 for generating counterfactuals. If GPT-4 has systematic biases in what it perturbs, that leaks into training. The paper doesn’t deeply analyze the quality or diversity of these perturbations. The numbers are convincing but the dataset construction step needs more scrutiny.

Writing quality: Clear problem motivation and method description, but the experimental section rushes through results without enough failure analysis. When does the method still fail? What edge cases remain? The related work is thorough but could be tighter—some citations feel obligatory rather than directly relevant. The ablation section is strong. If I were rewriting one part, it’d be the results section: show representative failure modes alongside the aggregate metrics to give practitioners a realistic sense of limitations.

Verdict: Weak accept — Addresses a real problem with a reasonable solution and solid experimental coverage, but method feels somewhat incremental (combining existing techniques) and dataset construction isn’t interrogated enough. Contribution is more empirical than conceptual.

Takeaways

Practitioners can steal the perturbation-based data augmentation idea: when training any model that should ground predictions in specific evidence (not just vision—think retrieval-augmented generation, fact-checking, citation models), create minimal counterfactuals that keep everything fluent but swap the grounding claim. This gives you verifiable supervision without expensive human labels.

The batch-ranking loss for coherence is also transferable: if you’re building any comparative evaluator (code rankers, essay graders, content moderators), enforce transitivity explicitly rather than hoping pairwise training gives you a global ordering. Simple implementation: sample batches, compute all pairwise scores, add a loss term penalizing cycles.

Specific technique: the paper uses a structured reward combining pointwise score and relative ranking within batch. If you’re training reward models, this is a practical middle ground between Bradley-Terry pairwise losses (which ignore absolute quality) and regression losses (which ignore relative order).