UniToolCall: Standardizing How AI Agents Use Tools

Paper: 2604.11557 Authors: Yijuan Liang, Xinghao Chen, Yifan Ge, Ziyi Wu, Hao Wu, Changyu Zeng, Wei Xing, Xiaoyu Shen Categories: cs.AI

The Gap

Existing tool-use research for LLM agents is fragmented. Different papers use incompatible function-calling formats (JSON-RPC vs REST vs custom schemas). Training datasets ignore the structural patterns of how tools compose — whether calls happen in sequence or parallel, single-turn or multi-turn. Benchmarks measure different things with different metrics, making cross-paper comparisons meaningless.

The core issue: no one has treated tool-use as a structured interaction problem with explicit topology. Prior work focuses on individual function calls, not the graph of dependencies between them.

Problem: Fragmented tool-use ecosystem
   |
   v
Assumption: Tool interactions have learnable structural patterns
   |
   +---> Method: Unified representation (QAOA) + controlled synthetic data
   |
   +---> Evidence: 93% precision on Hybrid-20 (vs 85% for GPT-4)
   |
   v
Conclusion: Standardization + structural modeling > ad-hoc approaches

The Increment

One sentence: Before — every lab invents its own tool format and evaluation; after — a common substrate for comparing and training tool-use agents.

Core Mechanism

UniToolCall has three layers. First, a tool pool of 22k+ functions with standardized schemas. Second, a hybrid training corpus (390k instances) mixing 10 public datasets with synthetic trajectories that explicitly control interaction structure — single vs multi-hop, serial vs parallel execution, single vs multi-turn conversations. Third, a unified evaluation protocol (QAOA: Query-Action-Observation-Answer) that converts 7 benchmarks into a common format with metrics at function-call, turn, and conversation granularity.

The key innovation is Anchor Linkage for multi-turn reasoning. When generating a multi-turn trajectory, the system identifies “anchor” variables in early turns (e.g., a user_id returned by login()) and forces later turns to reference them. This creates explicit cross-turn dependencies, preventing the model from treating each turn as independent.

Data generation uses a two-stage process: sample a structural template (e.g., “3-hop serial chain with 2 parallel branches”), then instantiate it with tools from the pool. This ensures the training set covers diverse topologies, not just the patterns that happen to appear in public datasets.

Tool Pool (22k functions)
   |
   v
Template Sampler --> [serial/parallel/hybrid structure]
   |
   v
Instantiation --> Synthetic trajectory with Anchor Linkage
   |
   +---> Public datasets (10 sources, standardized)
   |
   v
Hybrid Corpus (390k instances)
   |
   v
Fine-tuning --> Qwen3-8B
   |
   v
Evaluation (QAOA format, 3-level metrics)

Think of it like building a highway system. Before, every city (research lab) had its own road standards — different lane widths, signage, traffic rules. You couldn’t drive a car trained in one city to another. UniToolCall is the interstate highway standard: unified lane markings (QAOA representation), controlled on-ramps and exits (structural templates), and explicit route dependencies (Anchor Linkage). The tool pool is the map of all possible destinations. Training data is generated by sampling routes with specific topologies (serial highways, parallel lanes, multi-level interchanges), ensuring the model learns to navigate any configuration. Evaluation measures whether the model reaches the destination (conversation-level), takes correct exits (turn-level), and stays in its lane (function-call-level).

Key Concepts

• QAOA Representation: Query-Action-Observation-Answer is a four-part structure for each interaction turn. Query = user input. Action = function call(s) the agent makes. Observation = results returned by tools. Answer = agent’s response to user. This separates “what the agent does” (Action) from “what the agent says” (Answer), making it possible to evaluate tool-use accuracy independently of conversational fluency. Example: User asks “Book a flight to Paris.” Action = search_flights(destination="Paris"). Observation = [{flight_id: 123, price: 450}]. Answer = “I found a flight for $450.”

• Anchor Linkage: A mechanism to enforce cross-turn dependencies in multi-turn conversations. When generating synthetic data, the system marks certain variables as “anchors” (e.g., session tokens, entity IDs). Later turns must reference these anchors, creating a dependency chain. Without this, models learn to treat each turn independently, failing on tasks like “use the user_id from turn 1 to fetch preferences in turn 3.” It’s like threading a needle through multiple beads — each bead (turn) must pass through the same thread (anchor variable).

• Structural Templates: Pre-defined patterns for tool interaction topology. Examples: single-hop (one function call), multi-hop serial (A → B → C), multi-hop parallel (A + B → C), hybrid (A → [B + C] → D). Training data is generated by sampling templates, then filling them with tools from the pool. This ensures coverage of diverse interaction patterns, not just the most common ones in public datasets. It’s the difference between learning chess by playing random games vs systematically studying openings, middlegames, and endgames.

Framework Shift

Before (mainstream approach):        After (this paper):

Dataset 1 (format A)                 Tool Pool (22k, unified schema)
Dataset 2 (format B)                        |
Dataset 3 (format C)                        v
    |                                Template Sampler
    v                                   /    |    \
Train on mixed formats          Serial  Parallel  Hybrid
    |                                   \    |    /
    v                                        v
Evaluate on benchmark X          Controlled synthesis + public data
(incomparable to Y, Z)                      |
                                            v
                                    QAOA unified format
                                            |
                                            v
                                  3-level evaluation (call/turn/conv)

From ad-hoc format mixing to controlled structural generation, the core shift is treating tool-use as a graph problem with explicit topology.

Expert Assessment

Problem choice: Real gap. The fragmentation is obvious to anyone who’s tried to compare tool-use papers — you can’t reproduce results because everyone uses different formats and metrics. This is infrastructure work the field needs.

Method maturity: Mostly engineering, not algorithmic novelty. Anchor Linkage is clever but simple. The value is in curation (22k tools, 10 datasets standardized) and systematic coverage of interaction patterns. The structural template approach is borrowed from program synthesis — not new, but well-applied here.

Experimental integrity: Baselines are fair. The Hybrid-20 setting (20 tools, 10 distractors) is genuinely hard. Numbers look solid. One concern: the paper doesn’t report how much of the performance gain comes from data volume (390k instances) vs structural diversity. Ablation on template types would strengthen the claims.

Writing quality: Section 3 (data generation) is dense and could use a figure showing the pipeline. The QAOA format is introduced too late — should be in the introduction. The related work section is thorough but reads like a literature dump. Rewriting it to highlight the specific gaps (format inconsistency, structural blindness, evaluation fragmentation) would make the motivation crisper.

Verdict: weak accept — Solid infrastructure contribution with strong empirical results, but limited algorithmic novelty. The field needs this standardization, even if the methods aren’t groundbreaking.

Takeaways

Structural templates for synthetic data: If you’re generating training data for any sequential decision-making task (not just tool-use), explicitly controlling the topology of trajectories beats sampling from a uniform distribution. Define templates (linear chains, trees, DAGs), then instantiate them. This ensures coverage of edge cases.

Anchor variables for multi-step reasoning: When fine-tuning models on multi-turn tasks, inject explicit dependencies between turns. Mark key variables in early steps and force later steps to reference them. This prevents the model from learning turn-independent shortcuts.

Three-level evaluation: For any agent task, measure at multiple granularities — atomic actions (function calls), episodes (turns), and full trajectories (conversations). Aggregate metrics hide where models fail. Fine-grained metrics reveal whether the issue is action selection, sequencing, or long-term planning.