Decomposition Buys Integrity, Not Yield

Paper: 2609.17464 Authors: Rong He Categories: cs.MA, cs.AI, cs.DC

The Gap

Multi-agent systems split a task across a tree of agents and justify the split with folklore: smaller contexts, cleaner separation, parallelism. That folklore is load-bearing. Teams spend real money on orchestration because it feels like more agents find more things.

The paper asks a sharper question: what does the split do to how much of what the leaves discover reaches the root? Not “can we parallelize?” but “of the findings that exist, how many survive the tree?”

That reframing exposes a missing quantity. Without a model of per-item retention through a hop, you cannot predict yield, compare flat vs deep, or say when delegation is worth its coordination cost. The gap is not “multi-agent is unproven.” It is “we have been optimizing architecture without a yield law.”

   FOLKLORE VS THE REAL QUESTION

   folklore (why we build trees)
     smaller contexts
     cleaner separation
     parallelism
     "more agents find more things"
         |
         v
   the sharper question
     not: can we parallelize?
     but: of the findings that EXIST,
          HOW MANY SURVIVE THE TREE
          to reach the root?
         |
         v
   the missing quantity
     per-item RETENTION through a hop
     without it you cannot
       predict yield
       compare flat vs deep
       say when delegation is worth its cost
         |
         v
   the real gap
     not "multi-agent is unproven"
     but "we optimized architecture WITHOUT A YIELD LAW"

The Increment

One sentence: Before this paper, multi-agent decomposition was justified by folklore about context and parallelism; after it, there is an explicit retention model in which yield separates from architecture, flat is optimal for discoveries, and depth is bought only on context integrity and cost.

Core Mechanism

The model is a tree. An agent handed b items keeps any one of them with probability r(b). The form of r is everything.

If r(b) = 1/b, every tree delivers exactly one finding, for every task size and every shape. The paper verifies this to 2.4 x 10^-15 on 20,000 random irregular trees. That is not a heuristic estimate; it is an algebraic identity under the model. A hop does not amplify discoveries; under this retention law it collapses the expected count to one, no matter how you arrange the agents.

If r(b) = C b^{-delta}, a depth-k tree over N findings yields C^k N^{1-delta}. Two factors separate cleanly:

• Task size contributes N^{1-delta}.
• Architecture contributes only C^k, with C <= 1 per level.

So flat is optimal for yield, and no arrangement of agents escapes the exponent delta. You can rearrange the tree; you cannot buy your way out of the retention exponent.

   THE RETENTION MODEL

   agent sees b items
   keeps any ONE of them with probability r(b)

   case r(b) = 1/b
     EVERY tree delivers EXACTLY ONE finding
     for every task size, every shape
     verified to 2.4e-15 on 20,000 random irregular trees
     a hop does NOT amplify; it collapses expected count to 1

   case r(b) = C * b^(-delta)
     depth-k tree over N findings
     yields  C^k * N^(1-delta)
         |
         +-- task size:     N^(1-delta)
         +-- architecture:  C^k, with C <= 1 per level
         |
         v
     FLAT IS OPTIMAL FOR YIELD
     no agent arrangement escapes the exponent delta

Production numbers make the model falsifiable rather than decorative.

On 600 production deep-research traces, delta = 0.34 with interval [0.30, 0.38], by three identifications that do not share a failure mode. That last clause is doing scientific work: three independent ways of recovering the same exponent.

At a hop where item boundaries come from the tool rather than a text heuristic, and where b = 1 occurs 550 times, C = 0.571 [0.527, 0.615] is observed rather than extrapolated, over 16,082 hops. Measuring C at b = 1 avoids the hardest identification problem.

Depth also costs alignment. On 1,012 annotated multi-agent traces, one brief in sixteen goes off-target, giving mu = 0.939 and a per-tier penalty C mu = 0.536. So each tier is taxed twice: retention and misalignment.

Depth is bought on two other axes — that is the paper’s constructive claim.

1. Context integrity. The root context is the only state that persists and the only one that cannot cheaply forget. Depth cuts its exposure from N items to N^{1/k}.
2. Cost. Production flat agents bill as N^{1.39}, not the N^2 an append-only context predicts. At equal spend, two tiers overtake flat at 403 findings.

And the punchline for practitioners: across every parameter measured, the model says 0.7% to 11.3% of production sessions are worth delegating, against 7.8% that do. A hazard model on 743,819 production tool calls finds that delegation does not respond to a filling context and is instead an opening move. Systems are not delegating when the context is heavy; they are delegating as a habit at the start.

   PRODUCTION CALIBRATION

   delta = 0.34  [0.30, 0.38]
     from 600 deep-research traces
     three identifications, no shared failure mode

   C = 0.571  [0.527, 0.615]
     observed at b=1 (550 times), 16,082 hops
     tool-derived item boundaries

   alignment tax
     1,012 annotated multi-agent traces
     1 brief in 16 off-target
     mu = 0.939
     per-tier penalty C*mu = 0.536

   what depth actually buys
     [1] root context integrity: N -> N^(1/k) exposure
     [2] cost: flat bills as N^1.39 (not N^2)
         two tiers overtake flat at 403 findings

   practitioner punchline
     worth delegating: 0.7% .. 11.3% of sessions
     actually delegating: 7.8%
     hazard model, 743,819 tool calls:
       delegation is an OPENING MOVE
       not a response to a filling context

Think of it as a factory that splits work across foremen. If each foreman only forwards one item out of every b they handle, then adding layers does not increase output — it just reshuffles which single item survives. Layers still help when the shipping dock (root context) cannot hold the full inventory, or when one foreman is cheaper than one giant workbench. That is integrity and cost, not yield.

Key Concepts

• Retention as the load-bearing law: without r(b), architecture debates are aesthetics.
• Yield / architecture separation: N^{1-delta} vs C^k means you cannot rearrange your way out of the exponent.
• Flat optimal for discoveries: if your goal is findings reaching the root, depth is a tax.
• Depth for integrity and cost: root context exposure shrinks; spend can beat append-only flat at high N.
• Alignment is a real tier penalty: off-target briefs compound with retention loss.
• Delegation as opening move: production systems delegate early by habit, not late by context pressure — a systems bug, not a strategy.

Framework Shift

Before (folklore):
  split the task because contexts are smaller
  -> more agents should find more things
  -> architecture chosen by taste and demos
  -> no yield law, no measured exponent

After (retention model):
  r(b) determines what survives to the root
  -> r=1/b: every tree yields exactly one finding
  -> r=Cb^\{-delta\}: yield = C^k N^\{1-delta\}
  -> flat wins on yield; depth buys integrity + cost
  -> delta=0.34 and C=0.571 measured in production
  -> most sessions should not delegate at all

From “decompose because it feels parallel,” to “decompose only when integrity or cost — not yield — is the binding constraint,” the core shift is that multi-agent architecture acquires a yield law and therefore a discipline.

Expert Assessment

Problem choice: Outstanding. This is one of the few papers that treats multi-agent orchestration as an object of measurement rather than advocacy. The folklore it targets — smaller contexts, cleaner separation, parallelism — is exactly what shows up in product pitches and blog posts, and the paper’s replacement question (what survives to the root?) is the one that determines whether money spent on agents is money well spent.

Method maturity: The model is deliberately simple, which is a strength for a first yield law. The special case r = 1/b giving exactly one finding for every tree is the kind of clean identity that makes a theory memorable and checkable. The general form C^k N^{1-delta} is the right decomposition: task size and architecture should not be confounded. Limitations: r is assumed stationary across the tree, alignment is reduced to a single mu, and the two “depth buys” axes (integrity, cost) are argued with production billing rather than a single unified optimization. That is fine for a measurement paper; it is not yet a design handbook.

Experimental integrity: This is where the paper is strongest among the five. Three non-shared failure modes for delta; observed rather than extrapolated C at b = 1 with a large hop count; annotated traces for mu; nearly 750k tool calls for the hazard model. The practitioner-relevant finding — delegation is an opening move, not a context-pressure response — is the kind of negative systems result that is easy to miss and expensive to ignore. Residual risk: one production stack’s traces; other harnesses may retain differently.

Writing quality: Abstract is dense with numbers and intervals, which is correct for this contribution. The folklore / question / model / calibration / implication arc is readable even when the algebra is skimmed.

Verdict: strong accept — a falsifiable yield law for multi-agent trees, production-calibrated, with the constructive side (what depth actually buys) stated as clearly as the negative side (depth does not multiply yield).

Takeaways

• Put a retention law on your hops before you add a tier. If you cannot estimate r(b), you are decorating, not designing.
• Separate yield from architecture. If C <= 1 per level, flat finds more; choose depth for context or cost, not discoveries.
• Measure the alignment tax. Off-target briefs compound with retention loss.
• Check whether your system delegates because the context is full or because the session just started. Habitual early delegation is a bug.