Equilibrium Reasoners: Learning Attractors Enables Scalable Reasoning

Paper: 2605.21488 Authors: Benhao Huang, Zhengyang Geng, Zico Kolter Categories: cs.LG

The Gap

Iterative reasoning models (like chain-of-thought or recurrent refinement) scale test-time compute by updating latent states. They work empirically, but we don’t understand why they generalize beyond memorized patterns. Prior approaches either rely on external verifiers (expensive, domain-specific) or task-specific priors (limits generality). The core mystery: what internal mechanism lets a neural network “think longer” and arrive at better solutions?

This paper proposes that generalizable reasoning emerges from learning task-conditioned attractors—latent dynamical systems where stable fixed points correspond to valid solutions. The hypothesis: if you train a network to iteratively refine a latent state, it learns a landscape where “rolling downhill” leads to correct answers.

Problem: Iterative models work, but mechanism unclear
   |
   v
Hypothesis: Networks learn attractor landscapes
   |                    (stable points = solutions)
   v
Method: Equilibrium Reasoners (EqR)
   |        - Scale depth (more iterations)
   |        - Scale breadth (multiple trajectories)
   v
Evidence: Convergence strength predicts accuracy gains
   |         Sudoku: 2.6% -> 99% with 40k-layer unrolling
   v
Conclusion: Attractor dynamics explain scalable reasoning

The Increment

One sentence: Before, we knew iterative refinement helps but not why; after, we have a mechanistic explanation (learned attractors) and a principled way to scale test-time compute (depth + breadth) without external verifiers.

Core Mechanism

Equilibrium Reasoners treat reasoning as a dynamical system. You start with a latent state (could be random, could be task-conditioned), then repeatedly apply a learned update function. The network is trained so that this iterative process converges to a stable fixed point—an attractor—that encodes a valid solution.

Two scaling axes: depth (run more iterations, like unrolling a recurrent network deeper) and breadth (start from multiple random initializations, aggregate their trajectories). Depth lets hard problems “settle” into attractors. Breadth hedges against bad initializations by exploring multiple basins of attraction.

The key insight: you don’t need an external verifier to know when to stop. The network learns to converge. Strong convergence (small change between iterations) correlates with correct solutions. Weak convergence signals the model is still “searching.”

Input (task) --> Latent state z_0
                      |
                      v
         +------------+------------+
         |  Update: z_t+1 = f(z_t, task)
         +------------+------------+
                      |
                      v (iterate until convergence)
                      |
         Attractor: z* (stable fixed point)
                      |
                      v
         Decode z* --> Solution

Think of it like a marble rolling on a landscape. The landscape’s shape is determined by the task (Sudoku vs. logic puzzle vs. math problem). Training carves valleys (attractors) at locations corresponding to valid solutions. At test time, you drop the marble (initialize latent state) and let physics (the learned update function) do the work. If the landscape is well-formed, the marble rolls into a valley (converges to a solution). Hard problems have shallow valleys—you need more time (depth) for the marble to settle. Multiple marbles (breadth) increase the chance that at least one finds a good valley.

Key Concepts

• Attractor: Imagine a bowl on a table. If you drop a marble anywhere inside the bowl, it rolls to the bottom and stays there. That bottom point is an attractor—a stable state the system naturally moves toward. In EqR, the “bowl” is the learned latent dynamics, and the “bottom” is a latent representation of a valid solution. The network learns to shape the landscape so that iterating the update function pulls you toward these stable points. Simple problems have deep, obvious bowls (converge fast). Hard problems have shallow, complex bowls (need more iterations to settle).

• Test-time scaling: Most neural networks are fixed at inference—you run one forward pass and get an answer. EqR lets you trade compute for accuracy *after training. Run more iterations (depth scaling) to let hard problems converge. Run multiple trajectories from different starting points (breadth scaling) to explore different solution basins. This is like giving the model “thinking time” without retraining. The paper shows this scales dramatically: equivalent to unrolling 40,000 layers for extreme Sudoku puzzles.

Framework Shift

Before (mainstream approach):        After (this paper):

Input --> Model --> Output           Input --> Init latent z_0
          (fixed depth)                        |
                                               v
  OR                                  +--------+--------+
                                      | z_t+1 = f(z_t)  |
Input --> Model --> Candidate         +--------+--------+
          |                                    |
          v                           (iterate until stable)
     Verifier (external)                       |
          |                                    v
          v                           Attractor z* --> Output
     Accept/Reject                    (no external verifier)

Depth = architecture                 Depth = test-time choice
Breadth = beam search (discrete)     Breadth = trajectory aggregation

From fixed-depth feedforward or verifier-dependent search to learned attractor dynamics with adaptive test-time scaling, the core shift is internalizing the convergence criterion.

Expert Assessment

Problem choice: Real gap. Test-time compute scaling is a hot topic (see o1, self-consistency methods), but the mechanistic story has been hand-wavy. Framing it through dynamical systems and attractors is intellectually satisfying and connects to a rich literature in optimization and physics. Not manufactured—this addresses a genuine mystery in why iterative refinement works.

Method maturity: Clever insight, not brute force. The attractor framing is elegant, but the implementation is straightforward: train a recurrent latent model with a convergence loss. The depth/breadth scaling is intuitive once you accept the attractor hypothesis. One concern: the paper doesn’t deeply explore *how to train networks to form good attractors—it mostly shows that if you train iteratively, attractors emerge. The training recipe feels underspecified for practitioners.

Experimental integrity: Baselines are fair. The Sudoku results are striking (2.6% → 99%), but Sudoku is a best-case scenario for this approach (discrete, verifiable, well-defined solution space). The paper acknowledges this and tests on other domains (logic, math), though less extensively. The 40k-layer claim is technically true but slightly misleading—it’s 40k *equivalent layers via iteration, not a single massive network. The convergence-accuracy correlation is well-documented and convincing.

Writing quality: The abstract and intro are strong—clear hypothesis, clean framing. The method section is dense and could use more intuition-building before diving into equations. The attractor metaphor is introduced but not fully exploited; a figure showing actual learned attractor landscapes would be illuminating. The related work section is thorough but reads like a checklist. Rewriting the method section with more visual aids and concrete examples would elevate the paper significantly.

Verdict: strong accept — Provides a mechanistic lens (attractors) for understanding iterative reasoning, demonstrates dramatic test-time scaling without verifiers, and opens a research direction. The Sudoku results alone justify publication, and the framework is general enough to inspire follow-up work.

Takeaways

For practitioners: If you’re building iterative reasoning systems, train with a convergence objective (minimize change between iterations) and monitor convergence strength at test time as a proxy for confidence. Don’t stop at a fixed iteration count—let the model tell you when it’s done. For hard instances, scale depth (more iterations) before scaling breadth (multiple trajectories), since depth is cheaper.

For researchers: The attractor framing suggests a new evaluation metric: measure the “basin of attraction” around correct solutions (how far can you perturb the initial state and still converge?). This could replace or complement accuracy. Also, the paper hints that training dynamics matter—networks that converge faster during training might form better attractors. Worth investigating training schedules that explicitly shape the attractor landscape.

Transferable technique: The depth/breadth scaling trade-off applies beyond reasoning. Any iterative refinement model (image generation, protein folding, trajectory optimization) could benefit from adaptive test-time scaling based on convergence signals. The key is training the model to converge, not just to output good answers.