AgenticPay: A Multi-Agent LLM Negotiation System for Buyer-Seller Transactions

Paper: 2602.06008 Authors: Xianyang Liu, Shangding Gu, Dawn Song Categories: cs.AI, cs.LG

Abstract

AgenticPay introduces a benchmark framework enabling language-based negotiation between multiple autonomous agents. The system models markets where buyers and sellers have private constraints and must reach agreements through multi-round dialogue rather than numeric bidding. The benchmark includes over 110 tasks spanning bilateral to many-to-many market scenarios, with comprehensive evaluation metrics for feasibility, efficiency, and welfare.

Key Contributions

• AgenticPay Benchmark: A comprehensive framework for evaluating LLM agents in negotiation scenarios with 110+ diverse tasks
• Multi-Agent Market Modeling: Supports bilateral, one-to-many, and many-to-many market configurations
• Private Constraint Handling: Agents must negotiate with hidden reservation prices and preferences
• Evaluation Metrics: Novel metrics for assessing negotiation feasibility, economic efficiency, and social welfare

The Problem

Traditional automated negotiation systems rely on numeric bidding protocols. However, real-world negotiations involve:

• Natural language communication
• Private information and constraints
• Strategic reasoning over multiple rounds
• Complex multi-party dynamics

Current LLMs lack systematic evaluation for these negotiation capabilities.

System Architecture

Market Structure

AgenticPay models markets with:

• Buyers: Have maximum willingness to pay (private)
• Sellers: Have minimum acceptable price (private)
• Items: Various goods with different attributes
• Rounds: Multi-turn dialogue for reaching agreements

Negotiation Protocol

1. Initialization: Agents receive private constraints and market information
2. Dialogue Phase: Agents exchange natural language offers and counteroffers
3. Agreement Phase: Parties reach consensus or negotiation fails
4. Settlement: Transactions are finalized based on agreed terms

Task Categories

The benchmark spans multiple complexity levels:

Scenario	Buyers	Sellers	Items	Complexity
Bilateral	1	1	1	Low
One-to-Many	1	N	N	Medium
Many-to-Many	M	N	K	High

Evaluation Metrics

Feasibility Rate

Measures whether negotiations reach valid agreements:

$F = \frac{\text{Successful Negotiations}}{\text{Total Negotiations}}$

Economic Efficiency

Evaluates how close outcomes are to optimal allocation:

$E = \frac{\text{Realized Surplus}}{\text{Maximum Possible Surplus}}$

Social Welfare

Assesses total utility across all participants:

$W = \sum_{i \in \text{Buyers}} (v_i - p_i) + \sum_{j \in \text{Sellers}} (p_j - c_j)$

where $v_i$ is buyer valuation, $p_i$ is price paid, $p_j$ is price received, and $c_j$ is seller cost.

Results

Testing with state-of-the-art LLMs reveals significant challenges:

• Long-horizon reasoning: Models struggle to maintain strategic consistency across multiple rounds
• Private information: Difficulty in inferring opponent constraints from dialogue
• Multi-party coordination: Performance degrades significantly in many-to-many scenarios
• Efficiency gaps: Substantial room for improvement in achieving optimal allocations

Why This Matters

As AI agents increasingly participate in economic transactions, understanding their negotiation capabilities becomes critical:

1. E-commerce: Automated price negotiation for online marketplaces
2. Supply Chain: Multi-party contract negotiations
3. Resource Allocation: Distributed systems requiring consensus
4. AI Safety: Understanding strategic behavior of autonomous agents

Takeaways

1. Language-based negotiation is hard: Current LLMs lack robust long-horizon strategic reasoning for multi-round negotiations
2. Private constraints matter: Handling hidden information is a key challenge for agent-based commerce
3. Scalability issues: Performance degrades significantly as market complexity increases
4. Benchmark foundation: AgenticPay provides a systematic framework for advancing negotiation capabilities in LLMs