The Interaction Tax: Why Letting Agents Read Each Other Destroys Their Diversity

Paper: 2608.23541 Authors: Summer Eunhyung Ann, Haokun Liu, Chenhao Tan Categories: cs.MA, cs.AI

The Gap

The multi-agent LLM literature is openly contradictory. Debate is reported to help. Critique loops are reported to help. Mixture-of-agents synthesis is reported to help. Against that, other work finds interaction adds cost without improving quality under equal budgets, or that plain independent sampling already captures whatever gains multi-agent setups provide. Both camps publish under matched budgets, and they disagree.

The authors argue the contradiction is partly a missing distinction: not all multi-agent communication is equal, and the field has been treating it as one thing. Different model families genuinely find structurally different solutions to the same problem. That structural difference is the resource being spent. So the question is not whether agents should interact, but which information they should exchange — and there is a specific, plausible way to spend the resource badly.

When agents read each other’s complete outputs, they converge within a single round. Every agent sees a full worked solution, and anchoring does the rest. The proposals collapse toward the first plausible answer, and the diversity that justified assembling a panel in the first place is gone. The authors name this the interaction tax.

   WHY THE LITERATURE DISAGREES
   debate helps / critique helps / synthesis helps
        vs
   interaction adds cost / independent sampling is enough
        |
        v
   [MISSING DISTINCTION] not all communication is equal
        |
        v
   different model families -> structurally different solutions
        |                                    |
        |                        this is the RESOURCE being spent
        v
   [THE COLLAPSE] agents read each other's COMPLETE outputs
        -> all agents see a full worked solution
        -> anchoring
        -> proposals converge WITHIN ONE ROUND
        -> the diversity that justified a panel is ERASED
        |
        v
   [GAP] the field asks "should agents interact?"
         when it should ask "what should they exchange?"

The Increment

One sentence: Before this paper, multi-agent results were read as evidence about whether agents should communicate; after it, a matched-budget study over 11 verifier-scored tasks shows the answer depends on what is exchanged — full solutions collapse diversity within one round, while independent proposal generation keeps it.

Core Mechanism

The experimental design targets the confound directly. Eleven optimizations tasks, each scored by a verifier rather than by a model judging its own work, which removes the obvious way to get a self-serving result. Budgets are matched across conditions, so “more agents” and “more compute” are not being compared by accident. And the intervention is the form of communication, held against a baseline of independent proposal generation.

Three findings come out, and the first is the structural one.

Full-solution interaction is a weak default. When agents exchange complete outputs, they collapse. The mechanism is specific and is stated plainly: it mainly makes agents stay close to the first solution they see instead of trying different approaches. This is anchoring, and it is not a failure of any individual model — it is a property of how a panel behaves when each member is shown a finished answer.

Independent proposal generation avoids the collapse. Generating proposals without the cross-reading step preserves the structural diversity that different model families bring. This is the result that reframes the disagreement in the literature: if independent sampling already captures the gains, that is not evidence that multi-agent systems are useless — it is evidence that the interaction being tested was the harmful kind.

Critique helps only if the violated rule is easy for the LLM to find and fix. This is the most practically useful finding, because it gives critique loops a condition rather than a verdict. Critique is not generically good. It pays when the failure is legible — a rule you can point at — and does not pay when finding the problem is itself the hard part.

Together, these shift the question. Performance depends less on the number of agents than on the information they exchange, and interaction helps only when agents share the right information at the right time.

   THREE COMMUNICATION REGIMES

   [A] INDEPENDENT PROPOSALS
       agent1 -> proposal1
       agent2 -> proposal2      (no cross-reading)
       agent3 -> proposal3
       -> diversity PRESERVED

   [B] FULL-SOLUTION INTERACTION
       agent1 -> full solution -> shared
       agent2 reads it, anchors, revises toward it
       agent3 reads it, anchors, revises toward it
       -> converge WITHIN ONE ROUND
       -> diversity ERASED  (the interaction tax)

   [C] TARGETED CRITIQUE
       works when the violated rule is
         EASY to find and fix  -> pays off
         HARD to find          -> does not

Think of it as a hiring panel that interviews candidates in a room together. The purpose of a panel with different backgrounds is that each member notices different things. But if you open the meeting by having the first interviewer present a complete, well-argued recommendation, the remaining interviewers now face a finished answer instead of a blank page, and their independent judgement quietly converts into agreement — often within a single round of discussion. The information was exchanged, at no cost in tokens, and the entire reason for having a panel was spent. The fix is not to stop talking; it is to collect independent verdicts before letting anyone see the others.

Key Concepts

• The interaction tax: the cost of communicating in a form that destroys the diversity the multi-agent setup exists to exploit. It is a tax rather than a bug because the exchange is not failing to transmit information — it is transmitting information that is actively harmful to the panel’s purpose.
• Structural diversity as the resource: different model families arriving at structurally different solutions. This is what a panel is for, and it is measurable, which means the cost of a communication scheme can be evaluated rather than assumed.
• Conditional value of critique: critique pays when the violated rule is easy to surface and fix. Turning “does critique help” into “when does critique help” is what makes the finding actionable, because most deployed critique loops can be checked against that condition cheaply.

Framework Shift

Before (interaction as a single variable):
  experiment: agents talk vs agents do not talk
  conclusion: "multi-agent helps" or "multi-agent does not"
  -> contradiction across papers, both under matched budgets

After (interaction as a form of information exchange):
  separate independent proposals from full-solution sharing
  -> independent generation: diversity preserved
  -> full-solution sharing: collapse within one round
  -> critique: value depends on rule legibility
  conclusion: performance tracks WHAT is exchanged, not HOW MANY
               agents are present

From debating whether agents should interact, to specifying which information they should exchange and when, the core shift is that the number of agents is not the design variable — the communication topology is.

Expert Assessment

Problem choice: Excellent, and genuinely clarifying. A literature that contradicts itself under matched budgets is a signal that a hidden variable is being varied, and identifying that variable — the form of communication — is worth more than another data point on either side of the disagreement.

Method maturity: The design is disciplined where it counts. Verifier-based scoring rather than model-based judging removes the most obvious route to a flattering result, and matched budgets make the comparison honest. Using 11 tasks across optimisation families gives the conclusion some generality. The mechanism identified — anchoring on a complete solution — is a well-understood phenomenon from human group decision-making, and the paper’s contribution is demonstrating it in this setting and quantifying the consequence.

Experimental integrity: Strong on the central comparison, with one caveat worth stating. The claim that independent proposal generation captures the gains is entangled with the specific agents and tasks chosen; different model families that are more similar to each other would leave less diversity to preserve, and would therefore show a smaller tax. The paper would be stronger if it characterised how the size of the tax scales with the dissimilarity between the agents, since that is the quantity a practitioner actually controls when choosing a panel.

Writing quality: Naming the phenomenon is the paper’s best move — “interaction tax” makes the finding portable, and the abstract states the mechanism in one sentence, which is exactly what a reader needs. What would improve the exposition is a concrete before-and-after: three proposals generated independently, then the same three after one round of full-solution sharing, side by side. That single example would make the collapse visible rather than only reported.

Verdict: strong accept — it converts a standing contradiction into a design question with an answer, and it does so with a mechanism specific enough to be tested in other settings.

Takeaways

• Stop evaluating multi-agent systems by agent count. Evaluate the communication topology, because that is what determines whether the panel’s diversity survives.
• Collect independent proposals before any agent sees another’s output. Anchoring on a complete solution collapses a panel within one round, and the cost is invisible in token accounting.
• Expect critique to pay only when the violated rule is easy to surface. If finding the problem is itself the hard part, a critique loop is an expensive way to add noise.
• Measure the structural diversity you actually have. If two models in a panel tend to propose the same thing anyway, there is no diversity to tax and no reason to expect a gain.