MOSS: Teaching Agents to Rewrite Their Own Source Code

Paper: 2605.22794 Authors: Qianshu Cai, Yonggang Zhang, Xianzhang Jia, Wei Xue, Jun Song, Xinmei Tian, Yike Guo Categories: cs.AI, cs.LG

The Gap

Existing self-evolving agents (Voyager, AutoGPT, LATS) only mutate text artifacts: prompt templates, skill libraries, memory schemas, workflow configurations. The agent harness itself—routing logic, hook ordering, state invariants, dispatch mechanisms—lives in code and remains frozen after deployment. When a structural bug appears (wrong execution order, missing error handler, broken state transition), text-layer evolution cannot reach it. The agent keeps failing on the same edge case until a human ships a code patch.

Problem: Structural failures unreachable from text layer
   |
   v
Assumption: Source code is a strictly more general mutation surface
   |
   v
Method: Multi-stage pipeline with code rewriting + replay verification
   |
   v
Evidence: 0.25 -> 0.61 score on OpenClaw (4 tasks, 1 cycle)
   |
   v
Conclusion: Source-level evolution subsumes text-level evolution

The Increment

One sentence: Before MOSS, agents could only tune their prompts and skills; after MOSS, they can rewrite their own execution engine.

Core Mechanism

MOSS operates as a deterministic pipeline triggered by production failures. First, it curates a batch of failure traces—user interactions where the agent crashed, timed out, or produced wrong outputs. Second, it delegates code modification to an external coding-agent CLI (pluggable, could be GPT-4 or Claude with agentic scaffolding). Third, it spins up ephemeral trial workers, replays the failure batch against the candidate code, and collects verdicts. Fourth, if the candidate passes replay verification, MOSS performs an in-place container swap with health-probe-gated rollback: the new code goes live, but if health checks fail within a grace period, the system reverts atomically.

Production Agent (running)
   |
   | (failures accumulate)
   v
Failure Batch Curator
   |
   v
External Coding Agent CLI  <--- pluggable (GPT-4, Claude, etc.)
   |
   | (generates candidate code)
   v
Ephemeral Trial Workers
   |
   | (replay batch against candidate)
   v
Verdict: pass/fail
   |
   +---> [fail] discard candidate
   |
   +---> [pass] In-Place Container Swap
              |
              +---> Health Probe (grace period)
                    |
                    +---> [fail] Rollback
                    |
                    +---> [pass] Promote to production

Think of MOSS as a surgical team operating on a living patient. The patient (production agent) keeps running while the team works. The diagnostician (failure curator) collects symptoms from recent cases. The surgeon (external coding agent) proposes an intervention—not a bandage on the skin (prompt tweak), but a structural repair (code change). Before touching the real patient, the team runs the procedure on cadavers (ephemeral trial workers replaying failure traces). Only if the cadaver trials succeed does the surgeon operate on the live patient, with a crash cart standing by (health probes + rollback). The key insight: you can’t fix a broken heart valve by changing the patient’s diet; you need to open the chest.

Key Concepts

• Source-level vs text-level mutation: Text-level evolution changes data consumed by code (prompts, skill files, configs). Source-level evolution changes the code itself—control flow, function signatures, class hierarchies. Text-level is a strict subset: any text artifact can be generated by code, but code can express logic (loops, conditionals, recursion) that no text artifact can. When the bug is “the agent retries failed API calls in the wrong order,” no amount of prompt engineering fixes it; you need to reorder the retry loop in code.

• Replay verification: After generating candidate code, MOSS doesn’t deploy it blindly. It replays the curated failure batch—actual user interactions that crashed the old agent—against the candidate in isolated trial workers. If the candidate still fails on the same inputs, it’s discarded. This is deterministic: unlike prompt-based evolution where the base model might ignore your new instruction, code either passes the test suite or it doesn’t. Replay verification is the forcing function that prevents MOSS from shipping regressions.

• In-place container swap with rollback: MOSS doesn’t spin up a new agent instance and redirect traffic. It swaps the code inside the running container, preserving process state and network connections. After the swap, health probes (lightweight checks: “can the agent still respond to ping?”) run continuously for a grace period. If any probe fails, MOSS atomically reverts to the old code. This makes evolution low-latency (no cold start) and low-risk (automatic undo on breakage).

Framework Shift

Before (text-layer evolution):        After (MOSS, source-layer evolution):

  Agent Harness (frozen code)           Agent Harness (mutable code)
        |                                      |
        v                                      v
  +-------------+                        +-------------+
  | Prompt      | <--- evolvable         | Prompt      | <--- evolvable
  | Skills      | <--- evolvable         | Skills      | <--- evolvable
  | Memory      | <--- evolvable         | Memory      | <--- evolvable
  | Workflow    | <--- evolvable         | Workflow    | <--- evolvable
  +-------------+                        | Routing     | <--- NEW: evolvable
                                         | Hooks       | <--- NEW: evolvable
  Structural bugs unreachable           | Dispatch    | <--- NEW: evolvable
                                         +-------------+
                                         
                                         Structural bugs now reachable

From data-plane tuning to control-plane rewriting, the core shift is making the execution substrate itself a first-class evolvable artifact.

Expert Assessment

Problem choice: Real gap. Deployed agents do fail structurally (wrong hook order, missing error paths), and text-layer evolution genuinely cannot reach those bugs. The authors correctly identify that code is Turing-complete while text artifacts are not. This isn’t a manufactured problem—it’s a natural next step after text-layer self-evolution hit its ceiling.

Method maturity: The pipeline is straightforward: curate failures, delegate to coding agent, replay, swap. The clever part is recognizing that you don’t need to invent a new code-rewriting algorithm—you can plug in any existing coding agent (GPT-4, Claude, Codex) and let MOSS handle orchestration. The weakness: MOSS inherits the coding agent’s brittleness. If the external agent generates subtly broken code that passes replay but fails on unseen inputs, MOSS promotes it. The paper doesn’t address how to build a richer test suite beyond replaying known failures.

Experimental integrity: Single benchmark (OpenClaw, 4 tasks), single evolution cycle, score goes from 0.25 to 0.61. That’s a 2.4× improvement, which is substantial, but the paper doesn’t show what happens in cycle 2, 3, or 10. Does performance plateau? Does the agent start rewriting itself into a corner? No ablation on which components matter (is replay verification essential, or does the coding agent alone do most of the work?). No comparison to a human fixing the same failures. The result is promising but thin—this feels like a proof-of-concept, not a mature system.

Writing quality: The abstract and introduction are sharp. The related work section is thorough. The method description is clear but lacks depth on failure modes: what happens when the coding agent generates code that compiles but has a logic bug? What happens when replay verification passes but the agent regresses on a different task? The evaluation section is the weakest—one benchmark, one cycle, no error analysis. Rewriting the evaluation to include multi-cycle runs, ablations, and failure case studies would elevate this from “interesting idea” to “credible system.”

Verdict: weak accept — The core insight (source-level evolution subsumes text-level evolution) is correct and underexplored. The system design is pragmatic. But the evaluation is too narrow to judge whether this scales beyond a single benchmark and a single evolution cycle. This paper opens a door; it doesn’t walk through it.

Takeaways

For practitioners building agentic systems: If your agent has recurring structural failures (wrong execution order, missing error handlers, broken state transitions), text-layer tuning won’t fix them. You need a mechanism to mutate the harness itself. MOSS shows that you can do this safely by (1) curating failure batches from production, (2) delegating code rewriting to an external agent, (3) replaying failures in ephemeral workers before promoting. The key transferable idea: treat your agent’s source code as just another evolvable artifact, but gate promotion with deterministic verification.

For researchers: The paper demonstrates that source-level evolution is feasible but leaves open questions about long-term stability. After N cycles of self-rewriting, does the codebase become unmaintainable? Do agents converge to local optima where further evolution degrades performance? A follow-up study tracking 10+ evolution cycles, measuring code complexity over time, and comparing to human-driven fixes would be valuable.

Concrete technique to steal: The replay verification pattern—curate a batch of failure cases, generate a candidate fix, replay the batch in isolation, promote only if all replays pass. This applies beyond agent evolution: you can use it for automated bug fixing, configuration tuning, or any system where you want to validate a change against known failure modes before deploying.