VL-Calibration: Teaching Vision-Language Models to Separate 'I Can't See' from 'I Don't Know'

Paper: 2604.09529 Authors: Wenyi Xiao, Xinchi Xu, Leilei Gan Categories: cs.CV, cs.AI, cs.CL

The Gap

Existing confidence calibration methods for LVLMs treat confidence as a single number: “How sure are you?” But when a model says “The cat is on the roof” with 90% confidence and gets it wrong, we don’t know if it misidentified a dog as a cat (vision problem) or correctly saw a cat but hallucinated the roof (reasoning problem). Prior work from text-only LLMs uses binary correctness (right/wrong) to train a holistic confidence score, which collapses these distinct failure modes into one signal. This matters because visual uncertainty often gets drowned out by strong language priors—the model “knows” cats sit on things, so it confidently hallucinates even when the image is ambiguous.

Problem: LVLM wrong answer (high confidence)
         |
         v
    Two failure paths:
    /              \
Vision failed    Vision OK, reasoning failed
(blurry image)   (hallucinated context)
         \              /
          v            v
    Prior work: Single confidence score
                (can't distinguish causes)
         |
         v
    This paper: Decouple into visual + reasoning confidence
         |
         v
    Evidence: Improved calibration + accuracy on 13 benchmarks
         |
         v
    Conclusion: Separating confidence sources reduces hallucinations

The Increment

One sentence: Before this paper, LVLMs had one confidence knob for everything; after, they have separate knobs for “did I see it right” and “did I reason correctly,” which lets them catch visual hallucinations without crippling valid reasoning.

Core Mechanism

VL-Calibration adds two confidence heads to an LVLM: one for visual confidence, one for reasoning confidence. During inference, the model generates both an answer and these two confidence scores. The training uses reinforcement learning (specifically PPO) with a reward that checks if the final answer is correct. But here’s the trick: instead of treating all tokens equally, the framework estimates which tokens depend heavily on visual grounding versus which are pure reasoning.

For visual confidence supervision, the paper introduces an intrinsic visual certainty metric combining two signals: (1) visual grounding measured by how much the model’s attention changes when you perturb the image (KL-divergence), and (2) internal certainty measured by token entropy. High grounding + low entropy = visually certain. This metric doesn’t need ground-truth perception labels—it’s self-supervised.

The RL optimization uses token-level advantage reweighting: tokens with high visual certainty get more weight when training visual confidence, while tokens with low visual certainty (likely hallucinated) get suppressed. This prevents the model from confidently asserting things it didn’t actually see, while preserving its ability to reason confidently about what it did see.

Input: Image + Question
         |
         v
    LVLM backbone
         |
    +----+----+
    |         |
    v         v
Visual     Reasoning
confidence confidence
head       head
    |         |
    +----+----+
         |
         v
    Answer + two confidence scores
         
Training loop (RL):
    Reward = answer correctness
    Visual certainty = grounding (KL) + entropy
    Token weight = f(visual certainty)
    Update heads with weighted advantages

Think of it like a witness testifying in court. The old approach asks: “How confident are you in your testimony?” The witness gives one number, but you don’t know if they’re unsure because the lighting was bad (vision) or because they’re fuzzy on the timeline (reasoning). VL-Calibration asks two questions: “How clearly did you see it?” and “How sure are you about what it means?” Now when the witness says “I’m 90% sure I saw it clearly, but only 40% sure about the timeline,” you know where the uncertainty lives. The visual certainty metric is like checking if the witness squints when describing details (low grounding) or hesitates between words (high entropy)—signs they’re filling in gaps rather than reporting what they saw.

Key Concepts

• Decoupled Confidence: Instead of one confidence score for the entire answer, split it into visual confidence (how well did I perceive the image) and reasoning confidence (how sound is my logic given what I perceived). This matters because an LVLM might correctly identify objects but hallucinate their relationships, or misidentify objects but reason correctly about what it thinks it saw. A single confidence score can’t capture this—it’s like averaging your vision prescription with your IQ score. Decoupling lets the model say “I saw this clearly but I’m unsure about the conclusion” or “I’m confident in my reasoning but the image was ambiguous.”

• Intrinsic Visual Certainty: A self-supervised metric that estimates how grounded a token is in the actual image, without needing human labels for what the model “should” have seen. It combines two signals: (1) If you slightly perturb the image (add noise, crop), does the model’s attention distribution change a lot? High change = low grounding. (2) Is the model’s token probability distribution sharp (low entropy) or diffuse (high entropy)? Low entropy = more certain. Together, these catch when the model is “making stuff up”—if attention doesn’t change with image perturbations, the token is driven by language priors, not vision. If entropy is high, the model itself is uncertain. This is like checking if someone’s description changes when you show them the photo from different angles—if it doesn’t, they’re not really looking at the photo.

• Token-Level Advantage Reweighting: In reinforcement learning, the “advantage” tells you how much better an action was than expected. Standard RL treats all tokens equally when updating the model. This paper weights each token’s advantage by its visual certainty—tokens that are visually grounded get more influence on the visual confidence head, while uncertain tokens (likely hallucinations) get downweighted. This focuses the optimization: “Learn to be confident about what you actually saw, and learn to be uncertain about what you’re guessing.” Without this, the model might learn to be confident about hallucinations if they happen to produce correct answers by luck, reinforcing bad behavior.

Framework Shift

Before (mainstream approach):        After (this paper):

Image + Question                     Image + Question
      |                                    |
      v                                    v
   LVLM                                 LVLM
      |                                    |
      v                              +-----+-----+
   Answer                            |           |
      |                              v           v
      v                          Visual      Reasoning
Single confidence <--RL--      confidence   confidence
"How sure?"                        |           |
                                   +-----+-----+
Binary reward:                           |
correct/incorrect                        v
                                     Answer
                                        |
                                        v
                                   Weighted RL:
                                   - Visual certainty metric
                                   - Token-level reweighting
                                   - Separate head updates

From monolithic confidence to diagnostic confidence, the core shift is treating uncertainty as a structured signal with identifiable sources rather than a scalar summary.

Expert Assessment

Problem choice: This is a real gap. LVLMs hallucinate confidently, and existing calibration methods from text-only LLMs don’t account for the vision-language interface. The problem sits at a critical juncture—LVLMs are being deployed in high-stakes domains (medical imaging, autonomous vehicles) where distinguishing “I can’t see” from “I don’t know” matters. The framing is sharp: prior work conflates failure modes, this paper separates them.

Method maturity: The intrinsic visual certainty metric is clever—using KL-divergence under perturbations to measure grounding is elegant and doesn’t require perception labels. However, the method is somewhat complex (two confidence heads, RL with custom reweighting, multiple hyperparameters). A simpler baseline would be: just train a visual confidence head with image perturbation consistency as supervision, no RL. The paper doesn’t explore this, which makes me wonder if the RL machinery is necessary or if it’s solving a problem that could be addressed more directly.

Experimental integrity: Thirteen benchmarks is thorough. The baselines include recent verbalized confidence methods (Self-Consistency, P(True), etc.), which is fair. The ablations show each component contributes, though I’d like to see failure case analysis—when does decoupling hurt? The out-of-distribution generalization is a strong signal. One red flag: no comparison to simpler non-RL approaches (e.g., just training visual confidence with perturbation loss). The numbers look good, but the paper doesn’t prove RL is essential versus just having two heads.

Writing quality: The abstract and intro are clear. The method section gets dense—Figure 2 tries to show everything at once and ends up cluttered. The intrinsic visual certainty metric is buried in Section 3.2 when it’s actually the key insight; it should be front and center. The related work section is thorough but reads like a checklist. If I were rewriting, I’d lead with a concrete failure example (show an LVLM hallucinating confidently), then introduce decoupled confidence as the solution, then dive into how to train it without perception labels. The current structure makes you work to see why this matters.

Verdict: weak accept — Solid contribution with clear improvements, but the method complexity and lack of simpler baselines leave questions about what’s essential versus what’s engineering.

Takeaways

The intrinsic visual certainty metric (KL-divergence under perturbations + token entropy) is immediately useful beyond this paper. If you’re working with any vision-language model and want to detect hallucinations without ground-truth labels, this gives you a self-supervised signal. The broader idea—decomposing confidence by failure mode—transfers to other multimodal settings: audio-text models could separate acoustic confidence from linguistic confidence, robotics could separate perception confidence from planning confidence. The token-level reweighting trick is also portable: whenever you’re doing RL on sequences and some tokens are more trustworthy than others, weight the advantages accordingly. Don’t just copy the two-head architecture; steal the diagnostic mindset: when a model fails, ask “which component failed?” and design confidence to answer that question.