AgentDropoutV2: Optimizing Information Flow in Multi-Agent Systems via Test-Time Rectify-or-Reject Pruning

Paper: 2602.23258 Authors: Yutong Wang, Siyuan Xiong, Xuebo Liu, Wenkang Zhou, Liang Ding, Miao Zhang, Min Zhang Categories: cs.AI, cs.CL

Abstract

Multi-Agent Systems (MAS) have demonstrated remarkable capabilities in complex reasoning tasks, but they face a critical vulnerability: the cascading propagation of errors generated by individual agents. AgentDropoutV2 addresses this challenge through a novel test-time rectify-or-reject pruning framework that dynamically optimizes information flow without requiring model retraining. The system functions as an active firewall, intercepting agent outputs and employing a retrieval-augmented rectifier that iteratively corrects errors using a failure-driven indicator pool. By leveraging distilled failure patterns as prior knowledge, the framework precisely identifies potential errors and prunes irreparable outputs to prevent downstream contamination. Empirical evaluation on extensive math benchmarks demonstrates an average accuracy improvement of 6.3 percentage points, with the system exhibiting robust generalization across varying task difficulties.

Key Contributions

• Test-time optimization framework: Introduces a training-free approach to enhance MAS reliability through dynamic output intervention and correction
• Retrieval-augmented rectification: Employs a failure-driven indicator pool that captures distilled error patterns to guide iterative error correction
• Adaptive pruning mechanism: Implements a rectify-or-reject strategy that surgically removes irreparable outputs while preserving system integrity through fallback mechanisms
• Empirical validation: Demonstrates consistent performance gains across multiple math benchmarks with an average 6.3 percentage point accuracy improvement

Methodology: Active Firewall Architecture

AgentDropoutV2 operates as an intermediary layer between agent outputs and downstream consumers, implementing a three-stage pipeline:

Stage 1: Error Detection - The system employs a failure-driven indicator pool containing distilled patterns of common error types. These indicators serve as prior knowledge, enabling the framework to flag potentially erroneous outputs before they propagate through the system.

Stage 2: Retrieval-Augmented Rectification - For flagged outputs, the framework invokes a retrieval-augmented rectifier that iteratively attempts to correct errors. This component leverages context-aware indicators to understand the specific failure mode and applies targeted corrections. The iterative nature allows for multiple correction attempts, with each iteration informed by the previous attempt’s outcome.

Stage 3: Pruning Decision - Outputs that resist rectification after multiple iterations are classified as irreparable and pruned from the information flow. A fallback strategy ensures system continuity by substituting pruned outputs with safe alternatives or triggering alternative reasoning paths.

The framework’s key innovation lies in its dynamic adaptivity: rectification effort scales with task difficulty, allocating more computational resources to complex problems while efficiently processing simpler cases.

Experimental Results and Analysis

The evaluation on math benchmarks reveals several important findings:

Performance Gains: AgentDropoutV2 achieves an average accuracy improvement of 6.3 percentage points across tested benchmarks. This gain is particularly pronounced in scenarios where error propagation would otherwise compound, demonstrating the framework’s effectiveness at breaking error cascades.

Generalization Capability: The system exhibits robust performance across diverse problem types and difficulty levels. The failure-driven indicator pool, despite being constructed from a finite set of error patterns, generalizes effectively to novel error manifestations.

Adaptive Resource Allocation: Analysis of rectification attempts shows that the system dynamically modulates its intervention intensity. Simple problems receive minimal intervention, while complex problems trigger more extensive rectification efforts, optimizing the trade-off between accuracy and computational cost.

Error Pattern Coverage: The context-aware indicators successfully resolve a wide spectrum of error types, from simple computational mistakes to more subtle logical inconsistencies. This breadth of coverage suggests that the distilled failure patterns capture fundamental error modes rather than surface-level symptoms.

Implications for Multi-Agent System Design

AgentDropoutV2 represents a paradigm shift in how we approach reliability in multi-agent systems. Traditional approaches rely on either rigid structural constraints that limit flexibility or expensive fine-tuning that reduces deployability. This framework demonstrates that test-time intervention can achieve comparable or superior results while maintaining system adaptability.

The active firewall metaphor is particularly apt: just as network firewalls inspect and filter traffic without modifying the underlying network infrastructure, AgentDropoutV2 monitors and corrects information flow without altering agent architectures. This separation of concerns enables the framework to be deployed across diverse MAS implementations.

The failure-driven indicator pool introduces an interesting form of meta-learning: rather than learning task-specific patterns, the system learns failure patterns that transcend individual tasks. This abstraction enables generalization and suggests potential applications beyond mathematical reasoning to other domains where error propagation poses challenges.

Takeaways

1. Test-time intervention can effectively mitigate error propagation in multi-agent systems without requiring model retraining or architectural modifications
2. Retrieval-augmented rectification guided by distilled failure patterns enables precise error identification and correction across diverse error types
3. Adaptive pruning with fallback strategies balances error prevention with system integrity, preventing both error propagation and system failure
4. The framework achieves 6.3 percentage point average accuracy gains on math benchmarks while exhibiting robust generalization across task difficulties
5. Separating reliability mechanisms from agent architecture enables flexible deployment and maintains system adaptability