AI4AI-Bench: Can an Agent Actually Rewrite a Training Algorithm?

Paper: 2608.20318 Authors: Yizhe Chi, Wenyi Li, Deyao Hong, Xiaoqiu Wang, Mingju Gao, Kaisen Yang, Bingxiang He, Youjie Zheng, Calvin Xiao, Qinhuai Na Categories: cs.AI, cs.CL, cs.LG

The Gap

Recursive self-improvement (RSI) is usually discussed as a property of an entire system: an AI that makes the next AI better. The authors point out that this reduces to something much narrower. What actually carries an improvement forward between generations is the training algorithm — the objective and the update rule. A better algorithm raises the compute-to-capability exchange rate for every run that follows, including the run that produces the next agent. So RSI is feasible only if an agent can design training algorithms.

That specific ability is not measured anywhere. Existing agentic-research suites reward the wrong thing: an agent can win by collecting more data, by tuning hyperparameters, or by making the evaluation harness cheaper, none of which changes how the model learns. No prior benchmark separates a change to how a run is executed from a change to how the model learns — and that is exactly the distinction RSI lives or dies on.

     [RSI CLAIM] Each generation improves the next
                |
                v
     What is inherited across generations?
                |
                +-- data pipeline?      no, retrainable
                +-- hyperparameters?    no, searchable
                +-- TRAINING ALGORITHM  <-- yes, this is the carrier
                |
                v
     [THE UNMEASURED ABILITY] Can an agent design one?
                |
                +-- prior suites: won by more data or tuning
                +-- no suite isolates "changed how the model learns"
                |
                v
     [GAP] RSI is unmeasured because the enabling skill is unmeasured

The Increment

One sentence: Before this paper, “self-improving AI” was an unfalsifiable claim because nobody could separate an agent that rewrote a learning rule from an agent that merely tuned a knob; after it, ten frozen repositories and hidden evaluators put a number on the distance left to travel — and that number is large.

Core Mechanism

The design is a frozen-repo tournament. Ten real research repositories are chosen, one per training-algorithm family, and each is frozen at its shipped algorithm. An agent gets four hours on a single B300 to rewrite that repository’s training algorithm however it likes. Its code is then taken away and rerun from scratch for up to twelve hours — no further agent intervention — and scored by a fixed evaluator the agent never sees. The comparison is always against the repository’s original algorithm under the identical procedure, so no amount of environment manipulation can flatter the result.

The scoring trick is worth pausing on. Ten repositories produce ten mutually incommensurable metrics: a wall-clock speedup, a convergence rate, a downstream accuracy. To average them, every task is mapped onto one common scale where zero is an uninformative model, one tenth is the algorithm the repository already ships, and one is the task optimum. This makes the headline number directly readable as “fraction of the available distance closed”, and it makes the honest baseline visible: anything at or below 0.1 achieved nothing, because the repository already shipped that.

The findings are more interesting than the ranking. Across 29 configurations of 6 systems on all 10 tasks, the mean score is 0.166 and the best system reaches 0.250 — under a fifth of the way from the existing algorithm to the optimum. The submissions explain where the missing distance went: most never change how the model learns at all. The minority that do average 0.226, against 0.126 for everyone else. Reasoning effort does not buy better algorithms directly; it buys the willingness to touch the learning rule, and only then does it pay — pushing that minority from 8% of submissions to 64% and the mean from 0.094 to 0.196.

   AI4AI-BENCH PROTOCOL
   +-------------------------------------------------------------+
   | 10 frozen repos, one per training-algorithm family          |
   +------------------------------+------------------------------+
                                  v
   +-------------------------------------------------------------+
   | AGENT PHASE: 4 hours, 1x B300, rewrite the training algo    |
   |   - repo readable, evaluator hidden, code taken at cutoff   |
   +------------------------------+------------------------------+
                                  v
   +-------------------------------------------------------------+
   | EXECUTION PHASE: rerun from scratch, up to 12 hours         |
   |   - no agent in the loop, fixed evaluator scores it         |
   +------------------------------+------------------------------+
                                  v
   +-------------------------------------------------------------+
   | NORMALISED SCALE                                            |
   |   0.0 = uninformative model                                 |
   |   0.1 = the algorithm the repo already shipped  <- baseline |
   |   1.0 = task optimum                                        |
   +-------------------------------------------------------------+
                                  v
   MEAN 0.166 (29 configs, 6 systems)   BEST 0.250
   Did not change how the model learns -> 0.126
   Did change how the model learns     -> 0.226

Think of it as a restaurant inspection that forbids tasting during service. The health inspector does not stand in the kitchen while the chef improvises; the inspector takes the written recipe, walks to a different kitchen, cooks it exactly as written, and grades the plate. This kills two forms of cheating at once. The chef cannot season to taste while being watched, because the inspector leaves; and the chef cannot claim credit for a good service, because only the recipe travelled. What the benchmark measures is not how well a system can coax a number upward in a live session — that is the thing everyone already does well — but whether the written recipe, executed cold by someone else, is better than the one on file.

Key Concepts

• The compute-capability exchange rate: the amount of capability obtained per unit of compute. A training-algorithm improvement compounds because every later run — including the one that produces the next generation of agent — converts compute into capability more efficiently. This is why the authors argue RSI is fundamentally an algorithm-design question rather than a data or scale question.
• Execution change versus learning change: the distinction the benchmark is built to enforce. Rewriting a data loader, changing batch order, or restructuring the training loop changes how a run is executed; changing the objective or the update rule changes how the model learns. Only the second compounds across generations, and existing suites conflate the two.
• The normalised gap: rescaling incommensurable metrics so that the shipped algorithm sits at 0.1 and the optimum at 1.0. This turns a leaderboard into a measurement of remaining distance, and makes it impossible to report a win for reproducing what the repository already did.

Framework Shift

Before (agentic research benchmarks):
  Agent works inside the loop, live
    -> reward hacking available (cheaper eval, more data, tuning)
    -> "improvement" is entangled with execution environment
    -> result: uninterpretable for RSI

After (AI4AI-Bench):
  Agent writes the algorithm, then is removed
    [agent 4h] -> freeze code -> [rerun 12h, hidden evaluator]
    -> baseline is the shipped algorithm, on one scale
    -> result: 0.166 mean, "under a fifth of the gap closed"

From measuring whether an agent can drive a number up while it is watching, to measuring whether its written learning rule survives being executed by someone else, the core shift is refusing to let the agent be present when its own idea is tested.

Expert Assessment

Problem choice: Excellent, and unusually well-aimed. The community has spent two years arguing about RSI using evidence that mostly measures scaffold engineering. Isolating algorithm design as the load-bearing sub-ability, and making the benchmark’s baseline the repository’s own shipped algorithm rather than a naive one, is the kind of framing other agentic-research benchmarks should have adopted from the start.

Method maturity: The protocol design is the clever part, not the models. Separating a four-hour authoring phase from a twelve-hour execution phase, hiding the evaluator, and rescaling incommensurable metrics onto a scale anchored at “what the repo already had” are three independent design decisions that each close a specific cheat. The infrastructure cost, though, is real: ten B300-hours per task per configuration, which limits who can replicate this.

Experimental integrity: Strong on the axes they control. Reporting 29 configurations of 6 systems over 10 tasks, and publishing the task suite, the evaluators and every scored submission, is the right level of disclosure — this is checkable. The main soft spot is the 0.1 anchor: it assumes the shipped algorithms are comparable in how much headroom each leaves, and a repository that shipped a near-optimal algorithm contributes far less distance than one that shipped a poor one. Averaging ten such tasks into one mean is convenient but slightly lossy.

Writing quality: The decomposition of “most submissions never change how the model learns” into a percentage-of-submissions finding, then into a reasoning-effort causal story, is the paper’s best rhetorical move and it is genuinely informative. The paper would be stronger if it named the specific algorithm families whose learning-rule changes paid off, rather than only the aggregate.

Verdict: strong accept — it reframes RSI from a philosophical claim into a measurable engineering gap and hands the field the apparatus to argue about it.

Takeaways

• When you evaluate an agentic system on any research task, separate authoring from execution. If the agent is still present while its idea is being validated, you are measuring scaffolding, not ideas.
• Use the incumbent as the baseline and rescale to a fixed optimum. A leaderboard that lets a system score for reproducing what already existed cannot tell you how much distance remains.
• The finding that more reasoning effort mainly buys willingness to modify the learning rule — not better modification — is a concrete diagnostic. If your agent edits data pipelines but never objectives or update rules, extra thinking time will not fix it.
• Steal the hidden-evaluator discipline. Publishing the evaluators is right for reproducibility, but the agent must not see them during the run; both are achievable and the paper shows how.