Molecular Déjà Vu: Why Frontier LLMs Memorize Digits Instead of Learning Chemistry

Paper: 2609.05381 Authors: Matthias Busch, Marius Tacke, Sviatlana V. Lamaka, Mikhail L. Zheludkevich, Christian J. Cyron, Roland C. Aydin, Christian Feiler Categories: cs.AI

The Gap

Large language models (LLMs) are increasingly evaluated on scientific regression benchmarks, such as predicting molecular solvation free energy, lipophilicity, or binding affinity directly from SMILES strings. When an LLM posts an exceptionally low Mean Absolute Error (MAE) that rivals specialized graph neural networks or density functional theory (DFT) simulations, community excitement follows: the model appears to have discovered quantum chemical principles from natural language pre-training.

Yet a regression score cannot distinguish prediction from retrieval. If a molecule’s exact experimental property value is already recorded in the pre-training corpus, a model does not need to learn chemical mechanics; it only needs to look up the number. In the physical sciences, this leads to an absurd paradox: on the popular FreeSolv benchmark, the published experimental uncertainty is around 0.6 kcal/mol. If an LLM achieves an error of 0.025 kcal/mol, it has surpassed the precision of physical reality. Such precision cannot be prediction — it is photographic recall of a text table.

Prior work acknowledged general data contamination, but lacked systematic diagnostic tools to isolate verbatim retrieval from legitimate inductive generalization in continuous molecular regression.

[SCIENTIFIC BENCHMARK] SMILES String -> LLM -> Continuous Physical Value
    |
    v
[CORE DILEMMA] Does a low error indicate chemical understanding
               or verbatim recall of published literature?
    |
    +-------------------------+-------------------------+
    v                         v                         v
[PHYSICAL UNCERTAINTY]   [AUDIT SUITE]             [REASONING ABLATION]
FreeSolv noise ~ 0.6     22 frontier LLMs across   Zero-shot vs Heavy CoT:
kcal/mol; LLM reports    12 regression datasets    Does thinking suppress
MAE of 0.025 kcal/mol!   audited for digit matches or amplify lookup?
    |                         |                         |
    +-------------------------+-------------------------+
                              v
[EVIDENCE] Over 50% of frontier LLMs exhibit verbatim retrieval
on 5 major benchmarks; high reasoning increases retrieval by 89%;
suppressing retrieval collapses performance differences across models.

The Increment

One sentence: Before this paper, frontier LLMs were credited with emergent chemical intuition on molecular benchmarks; after it, their benchmark dominance is revealed to be digit-level retrieval of literature tables, where test-time reasoning acts as an index lookup rather than physical inference.

Core Mechanism

The authors conducted an exhaustive audit of 22 frontier models across 12 molecular property regression benchmarks (including FreeSolv, ESOL, Lipophilicity, and BACE).

The diagnostic framework operates across three key stages:

1. Verbatim Digit Alignment: Testing whether predictions match published literature values to exact decimal places (e.g. reproducing 3 to 5 significant digits matching legacy papers).
2. Reasoning-Level Auditing: Comparing the same models under low-reasoning (direct output) versus high-reasoning (extended Chain-of-Thought). Strikingly, extended reasoning triggered 89% more verbatim retrieval instances, indicating that internal chain-of-thought allows models to traverse associative memory paths to locate memorized citations.
3. Retrieval Interruption (Canonical vs Non-Canonical SMILES): By transforming the input representation (e.g. generating randomized non-canonical SMILES, atom-reordered representations, or synonymous IUPAC names), the authors severed the direct token-lookup trigger. Once retrieval was interrupted, the performance gap between top frontier models largely vanished, converging to a baseline level of actual generalizable prediction.

   RETRIEVAL VS PREDICTION FORENSIC PIPELINE

   [Input: Molecule SMILES]
             |
     +-------+-------+
     |               |
     v               v
 [Standard SMILES]  [Transformed/Scrambled SMILES]
     |               |
     v               v
 [Frontier LLM]     [Frontier LLM]
  (CoT Memory)       (Forced Inductive Path)
     |               |
     v               v
  Exact Match:       Degraded to Baseline Error:
  0.025 kcal/mol     ~ 1.15 kcal/mol
  (Memorized Table)  (True Inductive Generalization)

To visualize this dynamic, consider a structural metaphor of a trivia contestant who memorized the encyclopedia volume on world capitals. When asked the exact elevation of the capital of Burundi to four decimal places, a geographer would estimate based on topography and altitude maps, accepting a margin of error. The trivia contestant pauses, browses their mental index card of page 412, and recites the exact elevation down to the inch. If you disguise the country by giving only its coordinates, the contestant’s superpower vanishes instantly, revealing they know nothing about mountainous geography.

Key Concepts

• Digit-Level Verbatim Retrieval: The reproduction of empirical benchmark target values to exact decimal places stored from training papers, exceeding the ground-truth experimental measurement precision.
• Reasoning-Induced Retrieval Amplification: The counterintuitive phenomenon where increasing test-time reasoning tokens enables the model to locate and extract obscure memorized tabular data rather than calculating the answer.
• Retrieval Interruption: A methodology of perturbing syntactic surface forms (e.g. SMILES randomization) to break literal token associative memory without altering the underlying physical graph.

Framework Shift

Before (Naive Benchmark Faith):
SMILES ---> [Frontier LLM] ---> [Low Prediction Error] ---> Claim: "Model understands chemistry"
(Ignores the fact that error is lower than real-world instrument noise)

After (Forensic Contamination Audit):
SMILES ---> [Frontier LLM] ---> [Digit Match Audit] ---> Flag: Literature Retrieval
SMILES* --> [Interrupted]  ---> [Physical Error]     ---> Reality: True generalization ceiling

From trusting leaderboard MAE as an indicator of scientific insight to auditing whether predictions violate physical measurement uncertainty boundaries, the paradigm shifts from praise of emergent intelligence to forensic detection of literature memorization.

Expert Assessment

Problem choice: Outstanding. As LLMs are pitched for drug discovery and materials science, relying on models that merely quote old papers risks costly dead ends in wet labs.

Method maturity: The methodology is meticulous. Testing 22 different frontier models across 12 datasets with controlled reasoning budgets prevents the conclusions from being dismissed as quirks of a single architecture.

Experimental integrity: The authors cite the original paper errors and instrumentation tolerances (such as FreeSolv’s 0.6 kcal/mol limit), demonstrating that the LLM was scoring well below the noise floor of the physical experiment.

Writing quality: Clear, evidence-driven, and devoid of sensationalism. The tables showing exact digit matches across multiple models are unassailable.

Verdict: strong accept — A definitive study that changes how scientific machine learning benchmarks must be constructed and audited.

Takeaways

• If an AI model’s benchmark error is lower than the experimental uncertainty of the original apparatus, suspect memorization immediately.
• Extended reasoning (CoT) is not just a problem-solver; it is also a search engine into the pre-training corpus.
• For scientific benchmarks, always evaluate on perturbed, non-canonical representations (e.g. randomized SMILES or newly synthesized compounds) to separate memory from reasoning.