Scaling Discovery Requires Forgetting

Paper: 2610.20563
Authors: Shangyin Tan, Ben Zhou, Lakshya A Agrawal, Jialin Zhang, Yilin Chen
Categories: cs.AI, cs.CL

The Gap

Automated scientific discovery and iterative engineering optimization powered by LLM agents (such as automated kernel optimization, heuristic algorithm design, and neural architecture search) have emerged as premier frontiers of agentic AI. When practitioners seek to scale discovery compute, they standardly pursue three complementary axes:

1. Depth Scaling: Allowing a single agent to iterate across longer horizons (50+ turns).
2. Width Scaling: Running independent agent threads in parallel.
3. Communication Scaling: Enabling parallel agents to share insights and build upon one another’s intermediate candidates.

However, all three scaling strategies inevitably hit a hard empirical wall: as agents accumulate conversational history and experiment logs, marginal returns rapidly drop to zero. The authors diagnose the underlying cognitive mechanism: historical anchoring.

As context windows fill with dozens of prior failures and minor tweaks, the model’s attention is captured by its own historical trajectories. Instead of entertaining daring conceptual pivots, the agent makes timid, incremental modifications around previously explored code blocks. More compute budget merely produces more tokens of repetitive self-rationalization inside local minima.

   THE COGNITIVE ANCHORING TRAP IN EXTENDED AGENT SEARCH

   Turn 1-5: Bold initial exploration -> Finds decent Candidate A
         |
   Turn 6-25 (Accumulating Scratchpad Clutter):
   Context: [Candidate A, Fail 1, Fail 2, Patch 1, Fail 3, Micro-tweak 4...]
         |
         v
   Attention Bias: Agent's priors get anchored to Candidate A's structure
   Action: Produces minuscule, conservative tweaks; fears breaking existing code
         |
         v
   Turn 26-50: Zero progress! Adding compute budget yields flat plateau.
         |
         v
   SOLUTION: FORCED PERIODIC AMNESIA (FORGETTING)
   1. Keep only the highest-scoring candidate artifact on disk
   2. Completely wipe all conversation history, failed traces, and agent memory
   3. Re-spawn agents with a clean context, evaluating the candidate from scratch!

The Increment

One sentence: The authors show that scaling automated research requires periodically wiping agents’ accumulated conversation history and search traces, retaining only the global best candidate to break cognitive anchoring—delivering up to 39% improvement over single agents and 15% over communicating swarms under identical compute budgets.

Core Mechanism

The authors formalize the Periodic Amnesia Search (PAS) protocol for agentic discovery:

1. The Anchoring Measurement:
   • Behavioral analysis reveals that as context length grows, the edit distance (Levenshtein distance) between successive proposed code artifacts drops exponentially.
   • The token entropy of proposed diffs collapses, indicating that the LLM is mimicking its recent conversational turns rather than sampling from its broad pre-training prior.
2. The Forgetting Operator ($\mathcal{F}$):
   • Search proceeds in phases of $K$ iterations.
   • At the conclusion of each phase, a pruning operator $\mathcal{F}$ unconditionally discards the entire interactive scratchpad, tool call history, intermediate error messages, and failed attempts.
   • Only the physical artifact that achieved the highest verified score ($c^* = \arg\max_{c} \text{Score}(c)$) is retained.
3. Clean-Slate Re-initialization:
   • A fresh team of agents is instantiated. The artifact $c^*$ is presented as a clean, stand-alone specification without any historical baggage explaining how it was constructed or what failed previously.
   • Freed from contextual bias, the agents inspect $c^*$ with fresh attention distributions, immediately unleashing high-variance structural innovations that navigate past local optima.
4. Empirical Benchmarks Across Four Domains:
   • Validated across: (1) Heuristic algorithm programming, (2) GPU CUDA kernel optimization, (3) Model hyperparameter and training recipe search, and (4) Symbolic reasoning.
   • Yields up to 39% improvement over continuous long-context agents and 15% improvement over communicating multi-agent swarms.

   PERIODIC AMNESIA SEARCH (PAS) LIFECYCLE

   [Phase 1: High-Variance Exploration]
   Clean Agent Swarm ---> Generates Candidates c_1, c_2, ..., c_k
                              |
                              v
   Verified Best Candidate Found: c* (Score: 78.4)
   Accumulated Context: 45,000 tokens of clutter & failed dead-ends
                              |
                              v
   +-----------------------------------------------------------+
   | THE FORGETTING ACTUATOR                                   |
   | - DISCARD: 45k tokens of chat logs, reasoning, and errors |
   | - RETAIN: Pure artifact code of c* ONLY                   |
   +-----------------------------------------------------------+
                              |
                              v
   [Phase 2: Fresh-Slate Reboot]
   New Agents receive ONLY c* as baseline prompt: "Optimize this code"
   Attention is pristine; bold structural modifications resume!
   ===> Rapidly breaks through to Score 92.1!

Key Concepts

• Cognitive Anchoring in LLMs: The tendency of autoregressive language models to condition heavily on recent in-context tokens, causing generation entropy and conceptual diversity to shrink as history grows.
• Search Satiation: The state in agentic exploration where additional compute budget ceases to generate distinct search trajectories due to context window saturation.
• State-Free Restart: An optimization strategy that strips away historical search trajectory metadata, retaining only the objective state of the best discovered candidate.

Framework Shift

Before (Memory-Accumulating Agent Architectures):
  Dogma: "More context and memory is always better; never lose past learnings."
  Mechanism: Endless scratchpads, persistent memory vector stores, full chat histories.
  Failure Mode: Rapid stagnation; agents get paralyzed by past failed attempts.

After (Periodic Forgetting Architecture):
  Insight: For open-ended discovery, what an agent forgets is as vital as what it remembers.
  Mechanism: Periodically discard interaction logs and reboot from the single best candidate.
  Results: Unblocks search plateaus; +39% optimization gains under identical token budgets.

Expert Assessment

Problem choice: Profound and counter-intuitive. In an era obsessed with infinite context windows and lifelong memory stores, demonstrating that memory acts as an anchor that kills open-ended discovery is a breath of fresh air.

Method maturity: Elegant, minimalist, and universally applicable. It requires no complex fine-tuning or specialized vector databases—just a clean bash/python reset loop.

Experimental integrity: Tested across four diverse and technically demanding engineering domains (including real GPU kernel optimization where performance cannot be faked).

Writing quality: Lucid, philosophically compelling, and supported by rigorous quantitative metrics tracking code edit distances over time.

Verdict: strong accept — An essential design principle for anyone building autonomous coding, optimization, or scientific research agents.

Takeaways

• Stop feeding endless conversation history to autonomous research agents; cognitive anchoring cripples exploratory reasoning.
• Implement periodic forgetting: strip chat history every 5-10 iterations and re-prompt from the bare best candidate artifact.
• Evaluate agent search diversity not just by benchmark score, but by tracking the structural edit distance of generated solutions over time.