Aspire: Can Models Self-Evolve From a Vague Goal?

Paper: 2608.31111 Authors: Yuhao Wu, Jingyuan Zhang, Jiajun Shi, Yuxuan Zhang, Xinping Lei, Junting Zhou, Zexuan Wang, Yuchen Wu, Huan Zhou, Duo Wang, Yinzhu Piao, Yongchang Peng, Yunfeng Shi, Jin Chen, Zuo Wang, Jinkai Liu, Jiaheng Liu, Wenxuan Zhang, Shen Yan, Wenhao Huang, Ge Zhang Categories: cs.CL

The Gap

Many important forms of human learning begin with a vague goal: “become a better physicist”, “improve at research”. The learner must interpret the goal, identify their own capability gaps, decide how to learn, and judge whether they actually improved. That whole sequence is what makes the goal vague in the first place — none of the four steps is given.

Existing work on LLM self-evolution starts somewhere else. It begins with tasks and evaluation metrics specified by humans, which quietly removes the hard part: self-evolution becomes optimising an explicit objective rather than deciding what and how to learn. So the literature has been measuring a capability that is easier than the one the motivating analogy describes, and the gap between them is exactly the four steps that a specified objective hides.

   WHAT "VAGUE GOAL" LEARNING REQUIRES

   goal: "become a better physicist" / "improve at research"
        |
        +-- 1. INTERPRET the goal
        +-- 2. IDENTIFY your own capability gaps
        +-- 3. DECIDE how to learn
        +-- 4. JUDGE whether you actually improved
        |
        v
   that sequence is what makes the goal VAGUE:
   none of the four steps is given

   EXISTING SELF-EVOLUTION WORK
     starts with TASKS and METRICS specified by humans
        |
        v
     removes the hard part:
       self-evolution becomes OPTIMISING AN EXPLICIT OBJECTIVE
       rather than DECIDING WHAT AND HOW TO LEARN
        |
        v
   [GAP] the literature measures an EASIER capability than
         the motivating analogy describes

The Increment

One sentence: Before this paper, LLM self-evolution was evaluated against human-specified tasks and metrics; after it, ASPIRE supplies only a natural-language capability goal with hidden evaluation, and finds that agents complete the loops while weight-level gains remain sparse and unstable.

Core Mechanism

The design’s key decision is what it withholds. ASPIRE provides only a natural-language capability goal, while the downstream evaluation tasks remain hidden. That single choice restores all four of the missing steps: the agent must operationalise the goal by choosing data and update methods, constructing training and validation signals, and deciding when to evaluate.

Two further design choices make it a fair test of the full problem:

Both model-weight and agent-harness evolution are supported in a unified interactive environment. So the agent is not forced into one mechanism; it can edit weights, edit its own scaffolding, or both. This matters because the harness route is often easier, and separating the two lets the results show which one the agents actually make work.

Evaluation uses a hidden, expert-authored set of 520 items spanning six goals. Expert authorship and the spread over six goals prevent the evaluation from rewarding a single domain’s tricks, and hiding it prevents the agent from fitting the test — which is precisely the condition that human-specified benchmarks remove.

The findings are reported as a mixed picture, and the mixed picture is the contribution.

Vague goals redirect search effort toward goal interpretation. That is the mechanism working as intended: remove the specification, and the agent spends its effort on the missing step rather than on optimisation.

Agents routinely complete training and harness-editing loops. So the mechanics are not the bottleneck. Agents can run the pipeline.

But weight-level gains remain sparse and unstable, and the strongest evolved harness remains below the engineered Qwen-Agent reference. Both halves of that pairing are informative. Weight evolution — the harder route, and the one closest to the self-improvement story — mostly does not deliver. And harness evolution, which does produce something, still fails to beat a human-engineered harness. The self-evolution loop is not yet outperforming careful human design, even in the easier mode.

The failure analysis is the most useful part, because it names mechanisms rather than reporting a rate:

• Agents often train on mismatched data. Data selection, without supervision, goes wrong in a specific way.
• They trust narrow self-evaluations, so local gains fail to transfer to hidden evaluation. This is the crux: the agent’s own validation signal is the thing it can construct, and it is not a reliable proxy for the hidden goal.
• Continued search and training can erase earlier improvements. So the process is not merely flat; it can be non-monotone, which is what makes deciding when to stop one of the four missing steps rather than a formality.

   ASPIRE: WHAT IT WITHHOLDS

   provides: a NATURAL-LANGUAGE capability goal
   hides:    the downstream evaluation tasks
        |
        v
   -> the agent must OPERATIONALISE the goal:
        choose data and update methods
        construct training AND validation signals
        decide WHEN TO EVALUATE
        (all four missing steps restored)
        |
   supports BOTH:
     model-WEIGHT evolution     (the harder route)
     agent-HARNESS evolution    (the easier route)
   in a unified interactive environment

   EVALUATION: hidden, expert-authored, 520 items, six goals
     -> expert authorship + six goals stop single-domain tricks
     -> hiding it stops the agent fitting the test

   FINDINGS
     vague goals REDIRECT effort toward goal interpretation
     agents COMPLETE the training and harness-editing loops
     BUT: weight-level gains SPARSE AND UNSTABLE
          strongest evolved harness still BELOW the
          engineered Qwen-Agent reference

   FAILURE MECHANISMS (named, not just measured)
     train on MISMATCHED DATA
     trust NARROW SELF-EVALUATIONS -> local gains do not
       transfer to hidden evaluation
     continued search and training can ERASE earlier gains
       -> the process is non-monotone, so deciding when to
          stop is a real step

Think of it as asking someone to get better at something without telling them the exam. The alternative — giving them the exam topics and the marking scheme — is a legitimate exercise in optimisation skill, and it is not the same as exercising judgement about what to study. Remove the syllabus and three things happen at once: they spend real effort deciding what “better” means, they can in fact run study sessions, and the honest outcome is that they mostly plateau for the specific reasons the paper lists. The most instructive of those is the third: they mark their own homework, and their own marking is too narrow to predict the real exam. And the finding that continued study can undo progress is the practical warning — with no syllabus, you also have no signal telling you when to stop.

Key Concepts

• What withholding the evaluation buys: restoring goal interpretation, gap identification, method choice and stopping decisions as genuine problems. It is the design choice that turns a benchmark of optimisation into a benchmark of self-direction.
• Weight evolution versus harness evolution: two routes supported in one environment. Separating them is what reveals that the easier route (harness) produces something while the harder one (weights) mostly does not — and that neither yet beats human engineering.
• Self-evaluation as the fragile proxy: agents trust narrow self-assessments, so local gains fail to transfer to the hidden evaluation. It is the mechanism behind the sparse weight-level gains, and it is a consequence of the design rather than a coincidence.
• Non-monotone self-evolution: continued search and training can erase earlier improvements. It makes the stopping decision substantive, and it warns against assuming that more self-evolution rounds monotonically help.

Framework Shift

Before (tasks and metrics specified by humans):
  agent optimises an EXPLICIT objective
  -> goal interpretation, gap identification, method choice
     and stopping are all GIVEN
  -> measures optimisation skill, not self-direction
  -> no transfer problem, because the validation signal
     IS the objective

After (goal only, evaluation hidden):
  agent operationalises a natural-language goal
  -> must choose data, updates, validation signals,
     and when to evaluate
  -> weight gains sparse and unstable; evolved harness
     still below human-engineered reference
  -> local gains fail to transfer to hidden evaluation

From measuring how well an agent optimises an objective someone else specified, to measuring whether it can decide what to learn and how, the core shift is that the hard part of self-evolution is the specification the previous benchmarks supplied for free.

Expert Assessment

Problem choice: Excellent, and it makes a distinction the self-evolution literature had blurred. Pointing out that human-specified tasks and metrics remove the very steps that make a goal vague is the kind of observation that reframes a body of work, and it explains why self-evolution results have looked more encouraging than the motivating analogy warrants.

Method maturity: The design is well matched to the question: hide the evaluation, supply only the goal, and support both weight and harness routes in one environment so no mechanism is privileged. The hidden expert-authored set across six goals is the right evaluation structure, since it prevents both domain-specific tricks and fitting the test. The addition of named failure mechanisms — mismatched data, narrow self-evaluation, erasure by continued training — is what makes the negative result useful rather than merely discouraging.

Experimental integrity: Reporting that the strongest evolved harness remains below a human-engineered reference is the honest comparison, and it is the one a benchmark author has an incentive to omit; a result showing self-evolution beating nothing in particular would have been easier to publish. Reporting sparse and unstable weight-level gains, rather than a best case, is also right. The main limitation is inherent to a first benchmark: the results characterise current agents on this task set, and the natural next question — whether better validation-signal construction or better data selection closes the gap — is left open.

Writing quality: The abstract is unusually well structured for a benchmark paper: it states what is withheld, what is supported, what was found, and why the failures happen. Because the finding is largely negative, a concrete illustration — one goal, the data the agent chose, the validation signal it built, and the hidden evaluation it failed — would make the failure mechanisms far more actionable for anyone building on this.

Verdict: strong accept — it restores the missing steps of goal-directed self-improvement to the evaluation, and the resulting negative result, with named mechanisms, is more informative than another positive one.

Takeaways

• Hide the evaluation when testing self-direction. Supplying tasks and metrics measures optimisation skill, not the ability to decide what to learn.
• Watch for non-monotone self-evolution. Continued training can erase earlier gains, which makes deciding when to stop a substantive capability rather than a formality.
• Distinguish the two routes. Weight evolution and harness evolution are different difficulties, and a benchmark that merges them cannot tell you which one your system actually manages.
• Treat self-constructed validation signals as a known weak point. If the agent’s own evaluation is narrow, local gains will not transfer — that is the failure to design against first.