First-Token Confidence: A Zero-Cost Hallucination Detector

Paper: 2605.05166 Authors: Mina Gabriel Categories: cs.CL, cs.AI

The Gap

Self-consistency detects hallucinations by generating multiple answers and checking agreement, but costs N×decode_time. Semantic self-consistency improves accuracy by clustering answers by meaning rather than surface form, but adds both sampling overhead and external NLI model inference. The field assumes uncertainty estimation requires multiple samples.

This paper asks: is the multi-sample signal already present in a single decode?

Problem: Hallucination detection is expensive
   |
   v
Assumption: Uncertainty requires multiple samples
   |
   v
Method: Extract entropy from first answer token (phi_first)
   |
   v
Evidence: AUROC 0.820 vs 0.793 (semantic) on 3 models × 2 benchmarks
   |
   v
Conclusion: First-token distribution captures most uncertainty signal

The Increment

One sentence: Before this paper, hallucination detection required generating multiple answers; after, a single decode’s first token entropy achieves comparable accuracy at 1/N the cost.

Core Mechanism

The method computes phi_first from a single greedy decode. At the first content-bearing answer token (skipping “The answer is” preambles), extract the top-K logits, normalize them into a probability distribution, and compute entropy. High entropy = model is uncertain = likely hallucination. Low entropy = model is confident = likely correct.

The key insight: the model’s uncertainty about what word to start the answer with correlates strongly with whether the entire answer will be factually correct. If the model hesitates between “Paris”, “London”, “Berlin” at token 1, the full answer is probably wrong. If it confidently outputs “Paris” with 0.95 probability, the answer is likely right.

Input: "What is the capital of France?"
   |
   v
Greedy decode: "The answer is Paris."
   |
   v
Extract first content token: "Paris"
   |
   v
Top-K logits at that position: [Paris: 0.85, Lyon: 0.08, ...]
   |
   v
Normalize & compute entropy: H = -sum(p * log(p))
   |
   v
phi_first = 1 - (H / H_max)  [normalized to [0,1]]
   |
   v
Threshold: phi_first < 0.5 → flag as hallucination

Think of the model as a student taking a multiple-choice test. When the student immediately circles an answer without hesitation, they usually know it. When they hover between options, erasing and rewriting, they’re guessing. You don’t need to watch them take the test five times to know they’re uncertain—their first moment of hesitation tells you everything. phi_first is that hesitation, quantified. The model’s probability distribution at the first answer token is the “hover time” over the answer choices. High entropy = long hover = guessing. Low entropy = instant circle = knows it.

Key Concepts

• Entropy as uncertainty: Entropy measures how “spread out” a probability distribution is. If a model assigns 0.99 to one token and 0.01 to all others, entropy is near zero—the model is certain. If it assigns 0.25 to four tokens, entropy is high—the model is confused. Formally: H = -Σ p(x) log p(x). Imagine a bag of colored marbles. If 99 are red and 1 is blue, you’re almost certain to draw red (low entropy). If 25 are red, 25 blue, 25 green, 25 yellow, you have no idea what you’ll draw (high entropy). The model’s logits are the marble counts; entropy is your uncertainty about the draw.

• First-token privilege: Not all tokens are equal. The first content token sets the trajectory for the entire answer. If the model starts with the wrong entity name, the rest of the answer will rationalize that error. If it starts correctly, the rest usually follows. This is why first-token entropy is diagnostic: it’s the fork in the road where the model commits to a factual claim. Later tokens are mostly elaboration.

• Greedy decode sufficiency: Sampling-based methods assume you need to explore the model’s uncertainty by generating multiple diverse outputs. But the uncertainty is already encoded in the logit distribution. Greedy decode (always pick the highest-probability token) gives you one path, but the logits at each step show you all the paths the model considered. phi_first reads those logits directly instead of sampling from them repeatedly.

Framework Shift

Before (semantic self-consistency):        After (phi_first):

Generate N samples (N=5-20)                Generate 1 greedy decode
   |                                          |
   v                                          v
Cluster by semantic similarity             Extract first answer token
(requires NLI model)                          |
   |                                          v
   v                                       Read top-K logits
Measure agreement within clusters             |
   |                                          v
   v                                       Compute entropy
Output: agreement score                       |
                                              v
Cost: N × decode + NLI inference          Output: phi_first

                                          Cost: 1 × decode

From “sample the space to estimate uncertainty” to “read the uncertainty directly from the distribution.”

Expert Assessment

Problem choice: Real gap. Hallucination detection is a bottleneck in production LLM systems, and current methods (self-consistency, semantic clustering) are too expensive for real-time use. The paper targets a practical pain point, not an academic curiosity.

Method maturity: Elegant simplicity. The method is almost trivial—compute entropy at one token—but the insight is non-obvious: that first-token entropy is sufficient. The paper could have explored *why first-token entropy works (does the model front-load uncertainty? is this an artifact of instruction tuning?), but the empirical result is strong enough to stand alone. No simpler baseline is being overlooked; this is the simplest baseline.

Experimental integrity: Solid. Three models (Llama-2-7B-chat, Mistral-7B-Instruct-v0.2, Llama-3-8B-Instruct), two benchmarks (TriviaQA, NQ-Open), fair comparison to semantic self-consistency (the current best method). AUROC differences are modest but consistent. The subsumption test (correlation between phi_first and semantic agreement) is the right analysis—it shows phi_first isn’t just lucky, it’s capturing the same signal. One weakness: all models are 7-8B instruction-tuned. Does this hold for base models? For larger models (70B+)? Unknown.

Writing quality: The abstract and intro are crisp. The method section is almost too brief—Figure 1 does heavy lifting, but the text could walk through an example. The results section is thorough. The related work section is perfunctory (2 paragraphs). If I were revising, I’d expand the analysis section: *why does first-token entropy work? Is it because instruction tuning teaches models to “commit” early? Is it specific to factual QA, or does it generalize to reasoning tasks?

Verdict: strong accept — Practical, simple, well-executed. This should become the default baseline for hallucination detection.

Takeaways

1. Check first-token entropy before sampling: If you’re building a hallucination detector, compute phi_first first. If it’s already giving you AUROC > 0.80, you may not need the complexity of multi-sample methods.

2. Logits are underused: Most practitioners treat LLMs as text-in-text-out black boxes. This paper shows that reading the logits directly (not just the sampled tokens) gives you rich signal for free. Apply this to other tasks: Can logit entropy at key decision points predict reasoning errors? Can it detect out-of-distribution inputs?

3. First-token privilege is real: In your own prompts, pay attention to how the model starts its answer. If you’re doing chain-of-thought, the first reasoning step is disproportionately important. If the model hedges or equivocates at the start (“It could be X, but also Y…”), the rest of the reasoning is probably shaky.

4. Simplicity as a research strategy: This paper didn’t invent a new architecture or training method. It just measured something obvious (first-token entropy) that no one had systematically tested. Sometimes the best research is noticing what everyone assumed away.