Agents-A1: Scaling the Agent Horizon Instead of Parameters

Paper: 2606.30616 Authors: Lei Bai, Zongsheng Cao, Yang Chen, Zhiyao Cui, Shangheng Du, Yue Fan, Shiyang Feng, Zijie Guo, Haonan He, Liang He Categories: cs.CL

The Gap

The field has reached a frustrating inflection point: trillion-parameter models like Kimi-K2.6 and DeepSeek-V4-pro deliver impressive agent performance, but at astronomical compute costs that lock out most research labs. Meanwhile, smaller models struggle with long-horizon tasks—those requiring 10+ sequential steps of reasoning, tool use, and verification. The implicit assumption has been that raw scale is the primary lever for agent capability.

Prior approaches tried to compensate through better prompting, tool selection, or narrow domain fine-tuning. But these hit a ceiling: short-context models can’t maintain coherent reasoning over complex multi-step trajectories; single-domain specialists can’t generalize across heterogeneous task types (coding, science, web browsing, molecular analysis); and naively scaling SFT data doesn’t transfer knowledge efficiently between domains.

This paper identifies a different scaling axis entirely: horizon scaling. Instead of making the model bigger, make the training richer—longer trajectories and broader domain coverage. The logic flows cleanly:

                     Problem
                         |
                         v
  Large models expensive + Small models fail on
         complex multi-step agent tasks
                         |
                         v
                     Assumption
                         |
                         v
  "Horizon" (trajectory length + domain breadth)
       might substitute for parameter count
                         |
                         v
                      Method
                         |
          +--------------+---------------+
          |              |               |
          v              v               v
   Build 45K-token   Train domain    Distill multiple
   trajectory infra   teacher models   teachers into one
          |              |               |
          +--------------+---------------+
                         |
                         v
                    Evidence
                         |
                         v
   35B MoE matches 1T models on SEAL-0,
   IFBench, HiPhO, FrontierScience-Olympiad,
   MolBench-Bind; competitive on SciCode, HLE
                         |
                         v
                   Conclusion
                         |
                         v
   Horizon scaling is a viable alternative
   path to frontier agent performance

The Increment

One sentence: Before this paper, reaching trillion-parameter agent performance required trillion parameters; after this paper, a 35B model can match that performance by training on 45K-token trajectories across six domains using multi-teacher distillation.

Core Mechanism

The method has three stages, each building on the previous one like floors of a building.

Stage 1: Full-Domain SFT (Foundation). They start with a base MoE model and fine-tune it on agentic trajectories spanning six heterogeneous domains: code generation, scientific reasoning, web browsing, math/physics olympiads, molecular binding analysis, and frontier science questions. These trajectories average 45K tokens—dramatically longer than typical SFT data—because the authors built a “long-horizon knowledge-action infrastructure” that chains together external knowledge retrieval, action execution, observation parsing, and verifier feedback into coherent multi-step episodes.

Stage 2: Domain Teacher Training (Specialization). They train separate “teacher” models for each of the six domains. Each teacher becomes an expert in its domain’s specific patterns—how to structure code debugging sessions, how to chain physics reasoning steps, how to navigate web pages for information gathering. These teachers are trained on the same long-horizon infrastructure but on domain-specific data.

Stage 3: Multi-Teacher Distillation (Unification). Here’s the clever part. Instead of just picking the best teacher, they use all six teachers simultaneously to generate on-policy responses from the student model. A “domain router” determines which teacher’s output to weight more heavily for each token. They add a “salient vocabulary alignment” mechanism that focuses distillation loss on domain-specific vocabulary (e.g., Python keywords for code, chemical formulas for molecular tasks), making knowledge transfer more efficient. The result: one deployable 35B student that absorbed expertise from six specialized teachers.

Stage 1: Full-Domain SFT
=========================

  [Base MoE 35B] <-- SFT <-- [45K-token trajectories]
                                across 6 domains
            |
            v
  [Agentic Foundation Model]

Stage 2: Domain Teacher Training
=================================

  [Foundation] --> Train --> [Teacher: Code]
  [Foundation] --> Train --> [Teacher: Science]
  [Foundation] --> Train --> [Teacher: Browse]
  [Foundation] --> Train --> [Teacher: Math-Olympiad]
  [Foundation] --> Train --> [Teacher: Molecular]
  [Foundation] --> Train --> [Teacher: Frontier-Sci]

Stage 3: Multi-Teacher Distillation
====================================

       [Student Model 35B]
              |
              | on-policy generation
              v
    +----+----+----+----+----+----+
    |T-Code|T-Sci|T-Bro|T-Math|T-Mol|T-Fro|
    +----+----+----+----+----+----+
              |
              | domain-routed soft targets
              v
    [Salient Vocab Alignment]
              |
              v
    [Unified 35B Agent Model: Agents-A1]

Structural metaphor: The teaching hospital. Think of Agents-A1 as a medical resident at a teaching hospital. The hospital (infrastructure) provides long, complex patient cases—45K tokens worth of examination, diagnosis, treatment, and follow-up (trajectories). In Stage 1, the resident rotates through all departments (full-domain SFT), getting basic exposure to everything. In Stage 2, each department’s chief physician (domain teacher) has deep specialized expertise—the radiologist reads thousands of scans, the surgeon performs hundreds of procedures. In Stage 3, the resident doesn’t just shadow one attending; they present each case to all specialists simultaneously, with a smart scheduler (domain router) that says “for this cardiac case, weight the cardiologist’s feedback heavily.” The “salient vocabulary alignment” is like the resident learning to pay special attention when the cardiologist says “troponin” or the radiologist says “opacity”—focusing knowledge transfer on the terms that actually matter for each specialty. The graduating resident (Agents-A1) can now handle cases across all six departments from a single, unified knowledge base—without needing the computational overhead of consulting six separate specialists.

Key Concepts

• Agent Horizon: This is the paper’s central framing device. Traditional model scaling asks “how many parameters?” This paper asks “how far ahead can the agent think and act?” A short-horizon task might be “summarize this document” (one step). A long-horizon task is “browse multiple papers, extract relevant methods, write code to reproduce an experiment, debug it, and verify results” (20+ steps with external tool interactions). The average trajectory in their training data is 45K tokens—roughly 30-50 steps of reasoning and action. Think of it like the difference between a chess player who can see 2 moves ahead versus 15 moves ahead. The paper argues that training on these long trajectories is a fundamentally different capability than having more parameters.

• Multi-Teacher Domain-Routed Distillation: In standard knowledge distillation, one teacher transfers knowledge to one student. Here, there are six teachers, each expert in one domain. The “domain router” is a learned component that, for each input token, determines how much to weight each teacher’s output distribution. This is like having six tutors, and a meta-tutor who says “for this math problem, listen to the math tutor 70% and the science tutor 30%.” The “on-policy” part is crucial: the student generates its own responses first, then the teachers provide corrections—this prevents the student from just memorizing teacher outputs and instead teaches it to correct its own mistakes.

• Salient Vocabulary Alignment: Standard distillation minimizes KL divergence across the entire vocabulary (all possible next tokens). But different domains have different “important words.” For coding tasks, “def”, “class”, “return” are critical; for chemistry, “benzene”, “carboxyl” matter. This technique weights the distillation loss more heavily on these domain-salient tokens, so the student focuses its learning budget on what actually distinguishes experts from novices in each field. It’s like telling a language student “don’t worry about getting every word right—focus on the vocabulary that native speakers actually care about.”

Framework Shift

Before (mainstream approach):        After (this paper):
                                    
  More parameters                    Longer trajectories
       |                                  |
       v                                  v
  Bigger model                       Richer training signal
       |                                  |
       v                                  v
  Better agent performance           Better agent performance
       |                                  |
       v                                  v
  [Expensive]                        [35B matches 1T]

From “scale the model” to “scale the horizon,” the core shift is treating trajectory length and domain breadth as the primary levers for agent capability rather than parameter count.

Expert Assessment

Problem choice: This is a real and important gap. The field genuinely needs to understand whether trillion-parameter scales are necessary for frontier agent tasks, or whether smarter training can substitute. The paper sits at a productive intersection of scaling laws research, knowledge distillation, and agentic AI. However, the framing sometimes conflates “long-horizon” (trajectory length) with “broad-domain” (heterogeneous capabilities)—these are conceptually distinct axes, and the paper could be clearer about which contributes more to the final performance.

Method maturity: The multi-teacher distillation with domain routing is clever but not revolutionary—it’s a natural extension of existing mixture-of-experts and distillation ideas. The “salient vocabulary alignment” is a nice engineering contribution. The real innovation is the infrastructure: building a system that can generate coherent 45K-token agentic trajectories with proper verification is non-trivial and represents genuine systems work. Simpler approaches were tried (naive SFT, single-teacher distillation) and shown to be worse, which is good practice.

Experimental integrity: The baselines are headline models (Kimi-K2.6, DeepSeek-V4-pro), which is both a strength (showing practical competitiveness) and a weakness (these are proprietary models with unknown training details, so the comparison is somewhat apples-to-oranges). The benchmarks span a good range of agent tasks. However, the paper doesn’t adequately address: (1) What’s the compute cost of their three-stage training vs. simply training a smaller dense model with more data? (2) Ablations isolating “horizon length” from “domain breadth” would strengthen the core claim. (3) The 45K average trajectory length is impressive, but what’s the distribution? How many trajectories are actually long vs. padded?

Writing quality: The paper reads like a technical report—informative but not elegant. Section 3 (Method) would benefit from a cleaner narrative arc: right now it jumps between infrastructure details and training procedures. A dedicated “Limitations” section is conspicuously absent. The related work could be more concise. The figures are functional but not illuminating.

Verdict: weak accept — The core idea (horizon scaling as alternative to parameter scaling) is important and the results are compelling, but the paper oversells “horizon” as a unified concept when it’s really two things (trajectory length + domain breadth) stitched together, and the experimental design doesn’t fully isolate the claimed contribution.

Takeaways

Three concrete ideas to steal:

1. Long-horizon trajectory infrastructure: If you’re building agent systems, invest in infrastructure that chains multi-step actions with verification feedback. The 45K-token trajectory approach is more transferable than the model itself—you could apply this to any base model.

2. Domain-routed multi-teacher distillation: When you need one model to handle multiple specialized domains, train separate domain experts first, then distill with a learned router. This is cleaner than trying to do multi-task training from scratch.

3. Salient vocabulary alignment: When doing knowledge distillation for specialized domains, weight the loss on domain-critical tokens rather than uniform over the vocabulary. This is a simple technique that should be standard practice.