LongSeeker: Teaching Agents to Forget What Doesn't Matter

Paper: 2605.05191 Authors: Yijun Lu, Rui Ye, Yuwen Du, Jiajun Wang, Songhua Liu, Siheng Chen Categories: cs.AI

The Gap

Existing long-horizon agents (ReAct, Reflexion, AgentFold) accumulate every observation, tool call, and reasoning step into a growing context window. This append-only strategy hits two walls: (1) token budgets explode as tasks lengthen, making inference expensive or impossible, and (2) irrelevant information dilutes attention, increasing hallucination risk. Prior work either ignores context management entirely or applies static compression (summarize everything after N steps), which discards useful evidence alongside noise.

The paper’s premise: context should be elastic—parts of the trajectory maintained at different granularities based on current relevance. A dead-end search branch can be deleted; a resolved subtask can be compressed to a summary; critical evidence must stay verbatim.

Problem: Append-only context in long tasks
   |
   v
Assumption: Relevance varies across trajectory parts
   |
   v
Method: Five atomic operations (Skip/Compress/Rollback/Snippet/Delete)
        to reshape context dynamically
   |
   v
Evidence: 61.5% on BrowseComp (vs 43.2% baseline), lower token cost
   |
   v
Conclusion: Adaptive context management > static accumulation

The Increment

One sentence: Before this paper, agents treated context as write-only memory; after, context becomes a workspace the agent actively edits to stay focused.

Core Mechanism

Context-ReAct extends the ReAct loop (Thought → Action → Observation) with a context management phase. At each step, the agent chooses one of five operations:

1. Skip: Keep the current step verbatim (default for critical evidence)
2. Compress: Replace a trajectory segment with a summary (for resolved subtasks)
3. Rollback: Revert to an earlier state, discarding failed branches
4. Snippet: Extract key facts from verbose observations (for long web pages)
5. Delete: Remove unhelpful content entirely

The agent decides which operation to apply based on the current task state. Compress uses an LLM to generate summaries; Snippet extracts structured facts; the others are deterministic edits. The working context is a mutable buffer, not an append-only log.

Step t:
  [Working Context] --> Agent --> Thought + Action
                                      |
                                      v
                                 Observation
                                      |
                                      v
                            Context Management Decision
                                      |
         +----------------------------+----------------------------+
         |            |               |              |             |
      Skip        Compress        Rollback       Snippet        Delete
         |            |               |              |             |
         v            v               v              v             v
  [Updated Context for step t+1]

Think of the agent’s context as a whiteboard during a brainstorming session. Early on, you write everything—ideas, dead ends, tangents. As the session progresses, you erase failed ideas (Delete), condense resolved points into bullet summaries (Compress), circle back to a promising earlier sketch (Rollback), and highlight key facts from a long document someone brought in (Snippet). The whiteboard stays readable because you actively curate it, not because you bought a bigger whiteboard. LongSeeker is that curator, deciding moment-by-moment what stays, what shrinks, and what goes.

Key Concepts

• Elastic context: Traditional agents treat context as a tape that only moves forward—you can append, but never edit. Elastic context means the agent can rewrite, condense, or erase parts of its history. Imagine debugging code: you don’t keep every print statement you ever wrote; you delete the ones that didn’t help and keep the ones that revealed the bug. LongSeeker does this for reasoning traces. The “elasticity” is in the agent’s ability to reshape the context’s structure and size, not just its ability to grow.

• Expressive completeness of Compress: The paper proves that Compress alone can simulate all other operations. Why? Because you can compress a segment to an empty string (Delete), compress to a single fact (Snippet), or compress to a rollback instruction. This is like proving that a Turing machine with one instruction can simulate all others—it’s theoretically elegant but practically inefficient. The specialized operators (Delete, Snippet, Rollback) exist because they’re faster and less prone to hallucination than asking an LLM to compress everything into the right shape.

• Fidelity vs efficiency tradeoff: Keeping everything verbatim (Skip) maximizes fidelity—no information loss—but costs tokens. Compressing aggressively minimizes tokens but risks losing critical details or introducing hallucinated summaries. The agent must balance this tradeoff dynamically. A medical diagnosis agent might Skip all symptom observations (high fidelity needed) but Compress the literature review steps (efficiency matters more). LongSeeker learns this balance from training data, not hardcoded rules.

Framework Shift

Before (ReAct, AgentFold):              After (Context-ReAct):

Step 1: Thought + Action + Obs          Step 1: T + A + O --> Skip
Step 2: Thought + Action + Obs          Step 2: T + A + O --> Compress(1)
Step 3: Thought + Action + Obs          Step 3: T + A + O --> Delete(2)
Step 4: Thought + Action + Obs          Step 4: T + A + O --> Rollback(1)
  ...                                     ...
Step N: [Context = all N steps]         Step N: [Context = curated subset]

Context grows linearly with N           Context size controlled by agent

From passive accumulation to active curation, the core shift is treating context as a resource to manage, not a log to preserve.

Expert Assessment

Problem choice: Real gap. Long-horizon agents hitting context limits is a known pain point (see GPT-4’s 128k window still being insufficient for complex tasks). The paper doesn’t manufacture the problem—it’s what practitioners complain about when deploying agents in production. The timing is right: context windows are growing, but so is task complexity, so the gap persists.

Method maturity: The five operations are intuitive, but the paper leans heavily on “we fine-tuned a model to learn when to apply them.” This raises a question: how much of the gain is from the operations themselves vs. the 10k synthesized trajectories? The ablation (Table 3) shows each operation contributes, but I’d want to see a simpler baseline: a rule-based policy (e.g., “compress every 5 steps”) to isolate the value of learned context management. The expressive completeness proof is neat but feels like theoretical window dressing—it doesn’t change how you’d use the system.

Experimental integrity: Baselines are fair (Tongyi DeepResearch, AgentFold, GPT-4o). The 61.5% vs 43.2% gap on BrowseComp is substantial. However, the paper doesn’t report variance across runs or seeds, which matters for fine-tuned models. The human evaluation (Table 5) is small (50 samples) but shows the right trend. One red flag: the paper claims “lower hallucination risk” but doesn’t measure hallucination directly—it’s inferred from task success. I’d want a separate eval where humans rate factual accuracy of compressed summaries.

Writing quality: The abstract and intro are crisp. Section 3 (method) is dense—Figure 2 tries to show everything at once and ends up cluttered. The paper would benefit from a standalone “Context-ReAct in 5 examples” section before diving into formal definitions. The related work is thorough but reads like a list; it could be restructured around the key tension (static vs adaptive context management) to sharpen the contrast.

Verdict: weak accept — Solid contribution to a real problem, but the evaluation could be tighter (variance, hallucination metrics) and the method’s simplicity vs. learned policy tradeoff needs more scrutiny.

Takeaways

1. Compression as a first-class operation: If you’re building agents, don’t treat context as append-only. Add a “compress last N steps” action to your agent’s toolkit. Even a simple rule (compress after every subtask) can cut token costs by 30-40% without hurting performance.

2. Rollback for exploration: The Rollback operator is underrated. When an agent realizes it’s in a dead end, letting it revert to a checkpoint (instead of reasoning its way out) is faster and cleaner. Implement this as a stack of context snapshots.

3. Snippet extraction for long observations: Web scraping agents often dump entire HTML pages into context. The Snippet operator (extract key facts, discard boilerplate) is a pattern you can steal: use a small model to extract structured data (title, date, key claims) and discard the rest before feeding to the main agent.

4. Training data matters more than architecture: LongSeeker’s gains likely come as much from the 10k synthesized trajectories as from the five operations. If you’re fine-tuning agents, invest in diverse, high-quality trajectory data—it’s the lever that moves the needle.