Triadic Cognitive Architecture: Teaching AI Agents When to Stop Thinking

Paper: 2603.30031 Authors: Davide Di Gioia Categories: cs.AI

The Gap

Current LLM-based agents (ReAct, AutoGPT) use heuristic loops: they call tools, observe results, and decide whether to continue based on arbitrary stop-tokens or fixed iteration limits. This works in toy environments but breaks under real-world constraints: network congestion makes tool calls expensive, time decay makes slow decisions costly, and ambiguous evidence makes stopping criteria brittle. The core issue: these agents operate in “cognitive weightlessness” — they have no intrinsic sense of when thinking costs more than it’s worth.

Prior work treats agent reasoning as discrete symbolic steps. This paper asks: what if we model it as continuous-time physics, where information acquisition has friction, routing has geometry, and stopping has a value function?

Problem: LLM agents over-deliberate under resource constraints
   |
   v
Assumption: Reasoning can be modeled as stochastic control in continuous time
   |
   v
Method: Triadic Cognitive Architecture (spatial routing + temporal pacing + epistemic bounds)
   |
   v
Evidence: Emergency medical diagnosis simulation (EMDG)
   |
   v
Conclusion: Physics-grounded stopping reduces latency without sacrificing accuracy

The Increment

One sentence: Before this paper, agents stopped thinking based on heuristics; after, they stop when the expected value of information falls below the cost of acquiring it, computed via Hamilton-Jacobi-Bellman equations.

Core Mechanism

The Triadic Cognitive Architecture has three coupled components. First, spatial friction: the agent navigates a network where each tool lives at a node, and routing between tools incurs cost proportional to network congestion (modeled as Riemannian metric). Second, temporal friction: each action consumes time, and the environment state decays (e.g., patient condition worsens), creating urgency. Third, epistemic friction: observations are noisy, and the agent maintains a belief state that updates via nonlinear filtering; acquiring more information has diminishing returns.

The agent’s decision at each moment: which tool to query next, or stop and act? This is formulated as a coupled stochastic optimal control problem. The value function satisfies an HJB equation, but solving it exactly is intractable. Instead, the paper uses a rollout-based approximation: simulate forward trajectories under a heuristic policy, estimate the expected utility of continuing vs. stopping, and halt when net utility turns negative.

Belief State (b_t) ---> [HJB Value Function V(b,t)]
        |                           |
        v                           v
  [Nonlinear Filter]          [Rollout Policy]
        |                           |
        v                           v
  Observation (y_t) <--- [Tool Query] or [Stop & Act]
        ^                           |
        |                           v
  [Network Routing Cost] + [Time Decay Cost]

Think of the agent as a doctor in an emergency room. The hospital has diagnostic tools scattered across floors (spatial friction: elevators are slow during shift change). Each test takes time, and the patient’s condition deteriorates while you deliberate (temporal friction). Test results are probabilistic, and ordering redundant tests wastes resources (epistemic friction). The doctor must decide: run one more test, or make a diagnosis now? The Triadic Architecture formalizes this intuition: it computes a “stopping boundary” in belief-time space, where crossing the boundary means the expected benefit of another test no longer justifies its cost.

Key Concepts

• Cognitive Friction: In physics, friction opposes motion and dissipates energy. Here, friction opposes information acquisition: spatial friction (network congestion makes tool calls slow), temporal friction (environment state decays while you think), and epistemic friction (noisy observations have diminishing returns). The agent must “push through” these frictions to gather information, and the optimal policy balances information gain against friction costs. Without friction, the agent would query tools indefinitely; with friction, it learns to stop.

• HJB Stopping Boundary: The Hamilton-Jacobi-Bellman equation describes the optimal value function for a stochastic control problem. In this paper, the value function V(b,t) depends on the agent’s belief state b and time t. The stopping boundary is a surface in (b,t) space where V(stop now) = V(continue deliberating). Crossing this boundary triggers action. Unlike heuristic stop-tokens (“stop after 5 tool calls”), the HJB boundary adapts to the environment: under high congestion, the boundary shifts to favor early stopping; under low noise, it shifts to favor more deliberation.

• Rollout-Based Approximation: Solving the HJB equation exactly requires discretizing the infinite-dimensional belief space, which is computationally prohibitive. Instead, the paper uses rollout: at each decision point, simulate K forward trajectories under a simple heuristic policy (e.g., greedy tool selection), estimate the expected utility of each trajectory, and choose the action that maximizes expected utility. This is analogous to Monte Carlo Tree Search in AlphaGo, but applied to belief-space navigation rather than game-tree search.

Framework Shift

Before (mainstream approach):        After (this paper):

[LLM] --> [Tool Call] --> [LLM]     [Belief State b_t]
   |          |             |              |
   v          v             v              v
[Heuristic Stop Token]              [HJB Value V(b,t)]
   |                                       |
   v                                       v
[Action]                            [Stopping Boundary]
                                           |
                                           v
                                    [Action when V(stop) > V(continue)]

Discrete symbolic loop               Continuous-time stochastic control
Stop = arbitrary threshold           Stop = value-of-information < cost

From heuristic iteration to physics-grounded optimization, the core shift is replacing arbitrary stopping rules with a mathematically principled boundary derived from the agent’s belief dynamics and environment constraints.

Expert Assessment

Problem choice: This is a real gap. LLM agents deployed in production (customer support, medical triage) face latency and cost constraints that toy benchmarks ignore. The “cognitive weightlessness” framing is apt: current agents have no intrinsic sense of resource scarcity. However, the paper overstates the novelty — active learning and information-theoretic stopping criteria have been studied for decades in robotics and Bayesian optimization. The contribution is adapting these ideas to LLM agents, not inventing them.

Method maturity: The Triadic Architecture is conceptually elegant but computationally heavy. The rollout-based approximation requires simulating K trajectories at each decision point, which is expensive for large action spaces. The paper doesn’t compare against simpler baselines like myopic value-of-information (which only looks one step ahead) or threshold-based stopping (which halts when belief entropy drops below a threshold). These would be faster and might perform comparably in practice.

Experimental integrity: The Emergency Medical Diagnostic Grid (EMDG) is a custom simulation, not a standard benchmark. The baselines (greedy, random, fixed-iteration) are weak — no comparison against other principled stopping criteria like POMDP solvers or Bayesian active learning. The results show TCA reduces latency by 30% while maintaining accuracy, but without ablations, it’s unclear which component (spatial/temporal/epistemic friction) drives the improvement. The paper also doesn’t report variance across runs or sensitivity to hyperparameters (e.g., rollout depth K).

Writing quality: The introduction is dense with jargon (“Riemannian routing geometry,” “nonlinear filtering theory”) that obscures the core idea. Section 3 (Method) would benefit from a running example: show a concrete agent trajectory under TCA vs. baseline, step by step. The related work section is thin — it mentions ReAct and AutoGPT but doesn’t engage with the vast literature on active learning, POMDP planning, or anytime algorithms. The conclusion oversells the results (“demonstrates that triadic policies outperform greedy baselines”) when the evidence is limited to one simulated environment.

Verdict: weak accept — The problem is important, and the physics-inspired framing is intellectually satisfying, but the experimental validation is narrow and the method’s computational cost is underexplored. This feels like a strong workshop paper that needs more empirical grounding before claiming to solve agent deliberation in general.

Takeaways

Practitioners can steal the net-utility halting condition: at each decision point, estimate the expected benefit of continuing (information gain) minus the expected cost (latency, resource usage), and stop when this net utility turns negative. You don’t need the full HJB machinery — a simple Monte Carlo estimate over a few rollout trajectories suffices. This is applicable beyond LLM agents: any system that makes sequential decisions under resource constraints (A/B testing, hyperparameter tuning, medical diagnosis) can use this stopping rule.

The friction taxonomy (spatial, temporal, epistemic) is a useful lens for diagnosing agent failure modes. If your agent over-queries tools, ask: which friction is missing? Is it ignoring network latency (spatial)? Is it ignoring time decay (temporal)? Is it ignoring diminishing returns from redundant observations (epistemic)? Adding the missing friction term to your agent’s objective function often fixes the problem without redesigning the architecture.

The paper’s core limitation is also its lesson: physics-inspired models are elegant but expensive. Before reaching for HJB equations and Riemannian geometry, try simpler heuristics (myopic value-of-information, entropy thresholds). If those fail, then invest in the heavy machinery. Don’t start with a sledgehammer when a screwdriver might suffice.