MLLM-as-a-Judge Exhibits Model Preference Bias

Paper: 2604.11589 Authors: Shuitsu Koyama, Yuiga Wada, Daichi Yashima, Komei Sugiura Categories: cs.CV

The Gap

We’ve been using MLLMs to judge other MLLMs’ outputs — it’s faster and cheaper than human evaluation. But here’s the problem: nobody systematically checked whether these judge models play favorites. Prior work like LLM-as-a-Judge focused on text-only models, and multimodal evaluation studies assumed judges were neutral arbiters. This paper asks: what if the judge prefers outputs from models similar to itself?

The existing boundary is that we treat MLLM evaluation scores as ground truth for benchmarking, but we don’t account for systematic bias toward specific model architectures or training lineages.

Problem: MLLM judges may favor certain models
    |
    v
Assumption: Bias stems from architectural/training similarity
    |
    v
Method: Philautia-Eval (disentangle quality from preference)
    |
    v
Evidence: 1.29M caption-score pairs show self/family preference
    |
    v
Conclusion: Ensemble judges (Pomms) mitigate bias

The Increment

One sentence: Before this paper, we assumed MLLM judges were neutral; after, we know they exhibit measurable self-preference and family-preference biases that can be mitigated through ensembling.

Core Mechanism

Philautia-Eval works by collecting a massive dataset of caption-score pairs where different MLLMs judge captions generated by various MLLMs. The key insight is to separate two confounded factors: (1) actual quality differences between captions, and (2) systematic preference for certain generators.

The method uses a Bradley-Terry model to estimate both a “quality score” for each generator and a “preference bias” for each judge-generator pair. If a judge consistently rates one generator higher than quality alone would predict, that’s bias. They collect 1.29M evaluations across 12 MLLMs judging each other’s image captions.

Input: Image + Caption pairs from 12 MLLMs
    |
    v
[Judge MLLM A] --scores--> Caption from Generator X
[Judge MLLM B] --scores--> Caption from Generator X
[Judge MLLM C] --scores--> Caption from Generator X
    |
    v
Bradley-Terry Model:
  Score = Quality(Generator) + Bias(Judge, Generator)
    |
    v
Output: Disentangled quality vs. preference bias matrix

Think of it like a cooking competition where the judges are also contestants. You’d expect some judges to favor their own cooking style or the style of chefs they trained with. To detect this, you need many judges rating many dishes. If Judge A consistently rates Chef A’s dishes higher than other judges do (even after accounting for Chef A’s actual skill), that’s bias. Philautia-Eval is the statistical framework that separates “Chef A is genuinely good” from “Judge A just likes Chef A’s style.” The ensemble solution (Pomms) is like having a panel of judges with different biases — their individual preferences cancel out.

Key Concepts

• Self-preference bias (Philautia): When an MLLM judge rates outputs from itself higher than outputs of equivalent quality from other models. Named after the Greek concept of self-love. Imagine you’re grading essays and unconsciously give higher marks to essays that use your favorite phrases or argument structures — that’s self-preference. In MLLMs, this happens because the judge recognizes patterns from its own training or generation style.

• Family-preference bias: Models from the same “family” (sharing architectural components like vision-language connectors or trained on overlapping instruction-tuning datasets) prefer each other’s outputs. It’s like how people from the same school might unconsciously favor each other’s work because they share common frameworks and vocabulary. The paper found that LLaVA-family models prefer other LLaVA outputs, likely because they share the same connector architecture.

• Bradley-Terry model: A statistical framework originally designed for pairwise comparisons (like chess rankings). Here, it models each evaluation score as the sum of a generator’s inherent quality and a judge-specific bias term. This lets you answer: “Is Generator X scoring high because it’s genuinely good, or because Judge Y happens to like it?” The math assumes that if you have enough cross-comparisons, you can solve for both quality and bias simultaneously.

Framework Shift

Before (mainstream approach):        After (this paper):

MLLM Judge                          Multiple MLLM Judges
    |                                   |    |    |
    v                                   v    v    v
[Score] --> Benchmark Ranking       [Scores with bias terms]
                                         |
Assumption: Judge is neutral            v
                                    Disentangle quality
                                    from preference bias
                                         |
                                         v
                                    Ensemble to cancel bias
                                         |
                                         v
                                    Debiased Ranking

From treating judges as neutral measurement instruments to treating them as biased observers whose systematic preferences must be modeled and corrected.

Expert Assessment

Problem choice: This is a real gap with immediate practical consequences. As MLLM-as-a-Judge becomes standard practice (it’s already used in major benchmarks), undetected bias could create feedback loops where models optimize for judge preferences rather than actual quality. The problem sits at a critical juncture — we’re scaling up automatic evaluation before validating its assumptions.

Method maturity: The approach is solid but not groundbreaking. Bradley-Terry models are well-established, and the application here is straightforward. The real contribution is empirical: systematically demonstrating the bias exists at scale. The ensemble solution (Pomms) is almost too simple — just average multiple judges — but that’s actually a strength. No need for complex debiasing algorithms when a simple fix works.

Experimental integrity: The 1.29M evaluation dataset is impressive in scale. Baselines are fair. One concern: the paper focuses on image captioning, which might not generalize to other multimodal tasks. Also, the Bradley-Terry model assumes transitivity (if A > B and B > C, then A > C), which might not hold for subjective quality judgments. The bias measurements are convincing, but I’d want to see ablations on different prompt templates — could the bias be prompt-dependent?

Writing quality: The paper is clear but front-loads too much motivation. The related work section could be tighter. The experimental section is well-structured, but the discussion of why family bias occurs (shared connectors, overlapping data) feels speculative — they should either test these hypotheses directly or frame them as open questions. The Pomms section feels rushed; more analysis of which ensemble combinations work best would strengthen it.

Verdict: weak accept — The empirical finding is important and the dataset is valuable, but the method is incremental and the solution is obvious once you identify the problem.

Takeaways

Concrete steal #1: If you’re building any kind of AI-judged evaluation pipeline, don’t rely on a single judge model. The ensemble approach (Pomms) is trivial to implement and demonstrably reduces bias. Even just averaging two diverse judges helps.

Concrete steal #2: The Bradley-Terry decomposition technique transfers to any domain where you have multiple evaluators rating multiple items. If you’re doing human evaluation studies, you can use the same math to separate item quality from annotator bias. This is useful for quality control in data labeling.

Concrete steal #3: The concept of “family bias” suggests that when fine-tuning or building on top of existing models, you should test evaluation on models from different lineages. If you only validate on models from the same family, you might be measuring in-group preference rather than actual improvement.

Warning: The paper doesn’t address a deeper issue — if all MLLMs are trained on similar internet data, they might share biases that no ensemble can fix. The bias they measure is relative (Model A prefers itself over Model B), but there could be absolute biases (all models prefer certain caption styles) that remain invisible.