Does FLAIR Super-Resolution Erase or Hallucinate Small White-Matter Lesions?

Paper: 2608.06311 Authors: Zahra Khodakarami, Yue Li, Pulkit Khandelwal, John Detre, Sandhitsu Das, Christopher Brown, David Wolk, Paul Yushkevich Categories: cs.AI, cs.CV

The Gap

Here is the situation in clinical neuroimaging. FLAIR is the workhorse sequence for spotting white matter hyperintensities (WMH), the bright patches that track small vessel disease and predict cognitive decline. But in the clinic nobody acquires 1 mm isotropic FLAIR. You get 512x512 in-plane and 3-5 mm slices, because that fits in the scanner slot the radiologist actually has. So the voxel is a pancake, and a 4 mm lesion sitting inside a 5 mm slice is smeared into partial-volume mush.

Meanwhile the super-resolution literature has gotten very good at turning anisotropic scans into isotropic ones. Self-supervised methods like SMORE and its successor ECLARE learn the through-plane degradation from the subject’s own in-plane data, so no external training set is needed. Implicit neural representations fit a continuous function to the volume and can borrow structure from a co-registered T1. Both report excellent PSNR and SSIM, and both are increasingly dropped in front of segmentation pipelines as a free preprocessing win.

The gap is that PSNR and SSIM are global, intensity-domain, and completely blind to the thing that matters here. A super-resolution model that smooths away a 3-voxel lesion loses almost nothing in SSIM. A model that invents a plausible bright blob in the periventricular cap gains almost nothing in SSIM either. Both are catastrophic if your downstream endpoint is lesion count or lesion burden in a longitudinal dementia study. Prior work on SR-for-segmentation has largely reported Dice or volume correlation, which averages over lesion size and lets a fleet of missing small lesions hide behind one correctly traced large confluent one. Nobody had asked the per-lesion question directly: after SR, which real lesions disappeared, and which predicted lesions were never there?

   PROBLEM
   [clinical FLAIR = thick slices] --> [small WMH lost in partial volume]
        |
        v
   COMMON FIX
   [apply SR before segmentation] ..... validated only by PSNR / SSIM / Dice
        |
        | ASSUMPTION UNDER TEST
        v
   "SR is content-preserving for lesions"
        |
        +----> failure mode A: ERASURE (real small lesion smoothed away)
        |
        +----> failure mode B: HALLUCINATION (bright blob invented)
        |
        v
   METHOD
   [29 ADNI 1mm HR FLAIR + expert manual WMH]
        |
        v
   [simulate 3mm and 5mm through-plane degradation]
        |
        v
   [reconstruct: cubic | multi-contrast INR | ECLARE]
        |
        v
   [segment with MARS-WMH; per-LESION matching vs HR + manual]
        |
        v
   EVIDENCE
   floor = thick-slice seg  <  all SR  <  ceiling = HR seg
   erasure rate >> hallucination rate ; grows with slice thickness
   ECLARE > cubic ; INR ~= cubic
        |
        v
   CONCLUSION
   SR is a net win over raw thick slices, but it pays for it
   in silently deleted small lesions, not in fabricated ones.

The Increment

One sentence: Before this paper, “does super-resolution preserve lesions?” was answered with image-similarity metrics that cannot see a 3-voxel lesion; after it, we have a per-lesion audit showing the failure is asymmetric, that erasure dominates hallucination by a wide margin, and that the fancier multi-contrast INR buys nothing over cubic interpolation while the simple self-supervised ECLARE does.

Core Mechanism

There is no new network here. The contribution is an evaluation instrument, and the instrument has three moving parts: a controlled degradation ladder, a bracketed floor-and-ceiling reference frame, and a per-lesion matching accounting scheme.

The degradation ladder solves the paired-data problem. You cannot get the same brain scanned at 1 mm and at 5 mm with the identical lesion truth, so the authors start from 29 ADNI subjects who genuinely have 1 mm isotropic FLAIR with expert manual WMH tracings, then synthesize the thick-slice versions by simulating 3 mm and 5 mm through-plane acquisition. Every reconstruction is therefore attempting to recover a target that is exactly known, voxel for voxel, lesion for lesion. Three reconstructors are then run onto the HR grid: cubic interpolation as the no-learning control, a multi-contrast implicit neural representation that can lean on a co-registered T1, and ECLARE, a single-contrast self-supervised model that estimates the slice profile from the subject’s own in-plane data and trains its upsampler on that.

The bracketing is what turns raw numbers into interpretable ones. Segmentation of the simulated thick slice defines the floor: this is what you get if you do nothing. Segmentation of the original HR FLAIR defines the ceiling: this is the best any reconstruction could hope for, because it is the same segmenter on the real data. Any SR method now lands somewhere on a bounded interval instead of floating in an absolute number nobody can calibrate. Crucially, the choice of segmenter is itself an experimental variable, so four candidates (WMH-SynthSeg, segcsvd, MARS-WMH, TrUE-Net) are screened on HR and the main analysis is run under the one most sensitive to small lesions, MARS-WMH. That is the right direction to bias: use the most sensitive detector so that a lesion going missing is attributable to the reconstruction rather than to a blunt segmenter.

The accounting is then per-connected-component rather than per-voxel. Detection sensitivity asks what fraction of reference lesions are found. Erasure rate asks specifically about lesions that the segmenter did find on HR but lost after reconstruction, which isolates the reconstruction as the culprit. Hallucination rate asks about predicted components present in neither the manual tracing nor the HR segmentation, i.e. structures with no support from either reference. Splitting the error into these two named channels is the whole point: Dice would fuse them into one number and let them cancel.

   HR FLAIR (1mm iso)          manual WMH (expert)
        |                             |
        |                             +---------------+
        v                                             |
   [simulate through-plane blur + decimate]            |
        |                     |                       |
      3mm                   5mm                       |
        |                     |                       |
        +----------+----------+                       |
                   |                                  |
      +------------+------------+----------+           |
      v            v            v          v           |
   [cubic]      [INR w/ T1]  [ECLARE]   (raw thick)    |
      |            |            |          |           |
      +------------+------------+----------+           |
                   |                                  |
                   v                                  |
          [MARS-WMH segmentation]                      |
                   |                                  |
                   v                                  v
        +----- per-lesion component matching ---------+
        |                    |                   |
        v                    v                   v
   sensitivity          erasure rate       hallucination rate
   (found / ref)     (in HR seg, gone      (in pred, absent from
                      after SR)             manual AND HR seg)
        |
        v
   placed on the bracketed scale:
   [ raw thick ]===[ cubic ]==[ INR ]====[ ECLARE ]=====[ HR ]
      floor                                              ceiling

Think of it as restoring a photographic plate of a star field. The original 1 mm HR FLAIR is the pristine glass plate, and the expert manual tracing is the astronomer’s published catalog of stars on that plate. The simulated 3 mm and 5 mm acquisitions are two out-of-focus reshoots of that plate through progressively worse optics; the faint stars, which are your small lesions, are the first casualties. The three reconstruction methods are three restoration studios: cubic interpolation is the intern who just enlarges the print, the INR is the studio that also consults a second photograph of the same sky taken through a different filter (the T1), and ECLARE is the studio that first measures exactly how this particular lens blurs, then reverses that blur.

The segmenter, MARS-WMH, is the automated star-counting software you run over the restored print, and you deliberately pick the software with the lowest detection threshold so that a missing star is the restorer’s fault, not the counter’s. Then the two things you check are exactly the two things that ruin an astronomical catalog: did a real faint star get polished out of existence during restoration, and did the restorer paint in a star that was never in the sky? The floor is what the counter reports on the blurry reshoot untouched; the ceiling is what it reports on the pristine plate. The finding is that all three studios beat the untouched blurry print, but every one of them mostly errs by losing faint stars rather than by inventing them, and the lens-measuring studio loses the fewest.

Key Concepts

• Through-plane resolution and partial volume: A voxel is a little box, and the scanner reports one number per box: the average signal inside it. Clinical FLAIR boxes are roughly 1 x 1 x 5 mm, a pancake. Now put a 3 mm bright lesion inside a 5 mm-thick pancake. The box contains one part lesion and one part normal white matter, so the reported brightness is the average, which is much dimmer than the true lesion. This is partial-volume averaging, and it is why small lesions do not merely get blurry, they get *dim below the threshold at which any segmenter, human or machine, calls them lesions. Large confluent lesions survive because they fill whole voxels; small isolated ones do not. This single fact is why per-lesion analysis stratified by size is the only honest way to evaluate this pipeline.

• Erasure vs hallucination as separate error channels: Standard segmentation metrics are symmetric-ish summaries. Dice sees only voxel overlap, so ten missing 20-voxel lesions cost about the same as one slightly loose boundary on a 200-voxel lesion. This paper insists on splitting errors by direction and by cause. Erasure means: on the real HR data, the segmenter did find this lesion, then after reconstruction it did not. That conditioning on “found on HR” is the clever bit, because it removes the segmenter’s own blindness from the measurement and leaves only the damage done by the reconstruction. Hallucination means: a predicted component with no counterpart in either the manual tracing or the HR segmentation, so it is not merely a disagreement between two references but a structure nothing supports. The practical payoff: if erasure dominates, your downstream lesion counts are biased *downward, systematically and more severely for thicker slices, which is exactly the direction that mimics a treatment effect in a longitudinal study.

• Self-supervised slice-profile SR (ECLARE) vs implicit neural representation: ECLARE’s idea is almost embarrassingly direct. An anisotropic scan already contains its own training data: the in-plane directions are high resolution, and the through-plane direction is blurred by a slice profile you can estimate. So you take the sharp in-plane views, apply the estimated slice profile to make synthetic blurry-sharp pairs from that same subject, train a small network to invert it, and then apply it through-plane. No external dataset, no domain gap, and the degradation it learns to undo is the actual physical degradation of that scan. An INR instead fits a continuous function of spatial coordinates to the volume, optionally conditioned on a co-registered second contrast such as T1, and then samples that function on a dense grid. It is more expressive in principle, but it depends on registration quality and on the T1 actually carrying the lesion information, and T1 is notoriously poor at showing WMH. In this study it landed at cubic-interpolation level, which is the paper’s most quietly useful negative result.

Framework Shift

Before (mainstream approach):          After (this paper):

 thick FLAIR                            HR FLAIR + manual truth
     |                                        |
     v                                        v
 [ SR model ]                        [ simulate 3mm / 5mm ]
     |                                        |
     v                             +----------+----------+
 [ PSNR / SSIM ]                   v          v          v
     |                          [cubic]    [INR]    [ECLARE]   (raw)
     v                             |          |          |       |
 "looks great,                     +----------+----------+-------+
  ship it upstream                            |
  of segmentation"                            v
     |                                [most small-lesion-
     v                                 sensitive segmenter]
 [ segmentation ]                             |
     |                                        v
     v                              per-lesion ledger:
 [ Dice / volume corr ]              erasure | hallucination
     |                                        |
     v                                        v
 one averaged number             floor [==== SR ====] ceiling
 large lesions dominate          answer stratified by lesion size

 blind to: which small           tells you: direction of the bias,
 lesions vanished                which method, at which thickness

From global image fidelity to a per-lesion, direction-aware ledger bracketed between a do-nothing floor and a same-segmenter ceiling, the core shift is that preprocessing must be validated on the clinical endpoint it feeds, with errors named by their direction rather than averaged into a single similarity score.

Expert Assessment

Problem choice: Real gap, and well timed. Super-resolution is currently being bolted onto clinical neuroimaging pipelines at speed, marketed as a lossless resolution upgrade, and the validation culture around it is inherited from natural-image restoration where nobody counts 3-voxel objects. Asking “does the preprocessing quietly delete the biomarker?” is the correct sceptical question, and framing the answer as an asymmetry (erasure, not hallucination) is more useful than a pass/fail verdict, because it tells you the *sign of the bias you will see in your study. That matters concretely: a downward-biased lesion count that worsens with slice thickness will masquerade as a real effect wherever slice thickness correlates with site, scanner generation, or era. This sits squarely in the small but valuable genre of papers that audit tools everyone already uses.

Method maturity: The instrument is well-constructed rather than clever; the design decisions are mostly the right ones. Bracketing between a thick-slice floor and an HR ceiling is the correct way to make numbers interpretable, and choosing the segmenter that is *most sensitive to small lesions on HR is a genuinely thoughtful move because it stacks the deck against the reconstruction rather than in its favor. The obvious simpler approach nobody should overlook is size-stratified volumetric error, which the field could have run years ago; this paper effectively shows why the per-component version is worth the extra bookkeeping. The main immaturity is that the conclusions are one-segmenter deep. MARS-WMH was picked for a defensible reason, but the erasure rate is a joint property of reconstruction and detector, and a detector with a different threshold or a different training distribution could shift the ranking. Reporting the full four-segmenter grid, even in a supplement, would convert a finding into a law.

Experimental integrity: The baselines are fair and, importantly, include the two references that actually matter: cubic interpolation as the floor of learning-based value, and the raw thick slice as the floor of doing anything at all. Including the raw thick slice is what licenses the paper’s most policy-relevant sentence, that SR remains a net win despite the erasure, which is a more honest conclusion than a pure warning. The obvious red flag is simulated degradation. Real 2D thick-slice FLAIR is not a blurred 3D FLAIR: slice profiles are not ideal, there are inter-slice gaps, SNR differs, motion between slices is real, and 2D and 3D FLAIR have genuinely different tissue contrast. Simulation therefore almost certainly *understates erasure, so read the reported rates as a lower bound. Second, n = 29 in a single cohort (ADNI, so relatively cooperative, high-quality acquisitions, and a lesion-burden distribution skewed by the aging/AD population) is small for a claim about per-lesion rates, where the count of small lesions per subject is highly variable and a handful of high-burden subjects can dominate. I would want confidence intervals from subject-level bootstrapping and a stratification by baseline lesion load, since erasure rate in a subject with three tiny lesions is a very different quantity than in one with two hundred. Third, the hallucination definition is conservative by construction: anything the HR segmentation also produces is exempt, so shared false positives between HR and SR are invisible. That is a reasonable choice, but it means the headline “hallucination is not the problem” is specifically about hallucination relative to HR behavior, not about absolute anatomical plausibility. Finally, the INR result deserves a caveat the authors should state loudly: this is one implementation with one set of hyperparameters and one registration pipeline, not a verdict on the INR class, and multi-contrast INR performance is known to be sensitive to exactly those things, plus T1 is a weak source of WMH information to begin with.

Writing quality: The abstract is doing too much and prioritizing the wrong things. The segmenter-selection experiment across four methods is compressed into a subordinate clause, when it is arguably a standalone contribution: a comparison of four WMH tools by small-lesion sensitivity on 1 mm data is something readers would cite on its own. Conversely the actionable recommendation, which appears to be roughly “use ECLARE, do not trust small-lesion counts below some size at 5 mm, and do not assume multi-contrast helps”, is left for the reader to assemble. The section I would rewrite is the results: what this paper needs above all is an erasure-rate-versus-lesion-volume curve per method per thickness, with the size at which each method’s erasure crosses some tolerable threshold called out explicitly. That single figure would turn a set of aggregate rates into a usable operating guideline, and it is the thing every practitioner will actually want to look up.

Verdict: weak accept — a well-designed, genuinely useful audit with a clean asymmetric finding, held back by simulated rather than acquired degradation, n = 29 from a single cohort, and conclusions resting on a single downstream segmenter.

Takeaways

Things worth stealing, mostly transferable well beyond WMH:

• Condition your error metric on the ceiling model’s behavior. “Erasure = detected on HR, lost after reconstruction” is the move to copy. By requiring that the reference system already succeeded on clean data, you subtract the downstream model’s own incompetence out of the measurement and attribute the loss to the preprocessing. This generalizes to any pipeline where you want to isolate one stage’s damage: define the failure relative to what the same downstream model achieves on unmodified input, not relative to ground truth.

• Bracket every preprocessing claim with a do-nothing floor and a same-model ceiling. Reporting an SR method’s downstream score in isolation is uninterpretable. Reporting it between “raw degraded input” and “the pristine input through the identical downstream model” makes the fraction-of-recoverable-gap immediately readable, and it protects you from the two opposite errors of overselling (“SR is great”) and overwarning (“SR erases lesions, avoid it”). Both were true here simultaneously, and only the bracketed design shows that.

• Pick your downstream evaluator adversarially. They screened four segmenters and used the one most sensitive to the phenomenon at risk. If you evaluate with a blunt detector, your preprocessing looks safe because the detector was already missing everything. Choose the most sensitive available downstream model so that the residual failures are attributable to your stage.

• Split errors by direction and name them. Erasure and hallucination are not symmetric in consequence, and any metric that averages them (Dice, volume correlation, MSE) can hide a systematic one-directional bias. For any biomarker pipeline, ask which direction the bias runs, because a bias that correlates with an acquisition parameter will impersonate biology in a multi-site or longitudinal study. This is a general framing for evaluating generative preprocessing anywhere: sign of bias first, magnitude second.

• Expect the model that measures the actual degradation to beat the model with more capacity. ECLARE estimates the specific slice profile of the specific scan and inverts it; the multi-contrast INR has more expressive power and a second modality, and tied cubic. Domain-matched, subject-specific self-supervision beating a fancier architecture is a recurring pattern, and the corollary is practical: when adding an auxiliary modality, check first whether that modality actually carries the signal you care about. T1 mostly does not show WMH, so conditioning on it was never going to rescue faint lesions.

• Small objects need size-stratified evaluation, always. If a few large connected components can dominate your voxel-level metric, that metric is structurally blind to the small-object regime. Count objects, stratify by size, and report where performance falls off. This is the same lesson as small-object AP in detection, and it keeps being relearned.