Thermodynamic Computing: Let Physics Do the Sampling

Paper: 2607.16183 Authors: Owen Lockwood, Jérémy Béjanin, Joost Bus, Christopher Chamberland, Patrick Huembeli, Frank Schäfer, Guillaume Verdon Categories: cs.LG, cs.ET, physics.app-ph

The Gap

Machine learning workloads are consuming ever-more energy, and conventional digital hardware is approaching fundamental scaling limits. The fundamental problem: probabilistic ML models (energy-based models, Boltzmann machines, diffusion models) require sampling from complex distributions — an operation that’s painfully expensive when you simulate it step-by-step in digital logic.

Several prior threads converge here but none delivers a complete stack:

• Analog computing (e.g., Mythic, Lightmatter) accelerates deterministic inference but doesn’t address *stochastic workloads natively.
• Energy-based models (LeCun et al., 2006) are elegant in theory but notoriously hard to train and sample from in practice.
• Thermodynamic computing (e.g., Extropic, various physics-inspired chips) has been proposed conceptually but lacked a rigorous blueprint linking hardware physics to a practical ML training pipeline.
• Langevin dynamics / MCMC are well-studied sampling algorithms, but running them on digital hardware burns enormous energy per sample.

The gap: nobody has systematically shown how to close the loop — from tunable physical energy landscapes → hardware-native sampling → probabilistic graphical model construction → differentiable training → a practical computing stack with energy/runtime analysis and preliminary experimental hardware.

             [Escalating ML energy costs]
                        |
                        v
          [Sampling is the bottleneck]
            /          |           \
           v            v            v
   [Analog chips]  [EBMs theory]  [Thermo computing]
   (deterministic)  (hard to run)  (no full blueprint)
           \            |           /
            v           v          v
         [GAP: hardware-native stochastic sampling
          as a complete, trainable ML stack]
                        |
                        v
   [THIS PAPER: energy potentials in physical hardware
    + Langevin dynamics as native operation
    + PGM-based model construction
    + differentiable training pipeline
    + superconducting circuit prototype]
                        |
                        v
              [Theoretical + numerical
               energy/runtime analysis]
                        |
                        v
        [Orders-of-magnitude energy savings
         for probabilistic ML workloads]

The Increment

One sentence: Before this paper, thermodynamic computing for ML was a compelling idea without a rigorous blueprint; after this paper, there is a concrete, end-to-end stack — from physical energy landscapes through differentiable training to preliminary superconducting hardware — that shows exactly how and why this paradigm could work.

Core Mechanism

The architecture has three layers, each mapping to a physical concept:

Layer 1 — Hardware-native energy landscapes. The core physical substrate is a circuit whose state naturally evolves according to Langevin dynamics: dx = -nabla E(x) dt + sqrt(2T) dW. Here, E(x) is a tunable energy potential, T is temperature, and dW is Wiener noise. By physically implementing energy potentials with adjustable parameters (weights), you get a system that *automatically samples from the Boltzmann distribution p(x) proportional to exp(-E(x)/T) just by letting it reach thermal equilibrium. No explicit sampling algorithm needed — physics does it for free.

Layer 2 — Model construction via probabilistic graphical models. The paper shows how to compose hardware-native energy primitives into larger ML models. Energy-based models, Gaussian models, spin-glass models, and even variational autoencoders can be expressed as factor graphs where each factor corresponds to a hardware-implemented energy term. The total energy landscape is the sum of factor energies — and in hardware, this sum happens through circuit coupling.

Layer 3 — Differentiable training. The crucial bridge: you can compute gradients of the loss with respect to the energy potential parameters *through the equilibrium sampling process. Using the framework of equilibrium-based differentiation (the system at equilibrium defines a differentiable mapping from parameters to samples/statistics), the authors enable gradient-based optimization. Training loops become: set parameters → let hardware equilibrate → read statistics → compute gradients → update parameters.

+------------------+     +---------------------+     +------------------+
| PHYSICS LAYER    |     | MODEL LAYER         |     | TRAINING LAYER   |
|                  |     |                     |     |                  |
| Tunable energy   | --> | Factor graph / PGM  | --> | Equilibrium      |
| potential E(x)   |     | composing hardware  |     | differentiation  |
|      +           |     | energy primitives   |     |                  |
| Thermal noise    |     |                     |     | Gradient-based   |
| (natural W)      |     | Total energy =      |     | parameter        |
|      +           |     | sum of factor       |     | optimization     |
| Langevin         |     | energies            |     |                  |
| dynamics         |     |                     |     | Loss function    |
|      |           |     | Boltzmann dist =    |     | drives updates   |
|      v           |     | native distribution |     |                  |
| Equilibrium      |     |                     |     |                  |
| samples ~        |     |                     |     |                  |
| exp(-E(x)/T)     |     |                     |     |                  |
+------------------+     +---------------------+     +------------------+

The valley-and-ball metaphor. Imagine a landscape of valleys and hills carved into a flexible rubber sheet. Each valley represents a high-probability configuration — a valley’s depth corresponds to how likely that configuration is. Now imagine a ball bouncing around on this sheet, jostled by random air currents (thermal noise). Over time, the ball spends most of its time deep in the valleys — that’s the Boltzmann distribution.

The key insight is this: to train an ML model, you don’t simulate the ball’s bouncing in software. You physically shape the rubber sheet (tune the energy potential parameters) and let a real ball (the circuit’s physical state) actually bounce. When you want to learn, you observe where the ball tends to end up (sample statistics), compute how you’d want to reshape the valleys to better match your data (gradients), and physically adjust the sheet. Repeat.

Each component maps directly: the rubber sheet = energy potential, the ball = circuit state, the air currents = thermal noise, the valleys = modes of the target distribution, reshaping = gradient updates. Without the physical ball and real air currents, you’d need to simulate all of this bouncing numerically — which is exactly what burns energy in conventional computing.

Key Concepts

• Langevin dynamics: Think of it as the physics equation that governs how a particle drifts downhill (toward low energy) while being randomly kicked around by thermal noise. Mathematically: dx = -nabla E(x) dt + sqrt(2T) dW. The drift term pulls toward energy minima; the noise term prevents getting stuck and ensures correct sampling. Concretely: if you drop ink into water, the ink molecules follow Langevin dynamics — they drift downward under gravity but get scattered by water molecules, eventually spreading to a steady-state distribution. This paper says: let your *hardware be the water, and the ink molecules are your samples.

• Energy-based models (EBMs): Instead of explicitly defining a probability distribution, you define an *energy function E(x) and say the probability of a configuration x is proportional to exp(-E(x)/T). Low energy = high probability. This is like saying: instead of listing which cities are popular (explicit probabilities), you list the elevation of every city (energy). People naturally gather in the valleys (low-energy = high-probability states). The elegance: you can define arbitrarily complex distributions just by designing E(x), without worrying about normalization. The difficulty: computing those probabilities requires summing over all possible states — which is where sampling hardware becomes essential.

• Thermodynamic computing: The radical idea that computation doesn’t have to fight against physics — it can *harness it. Traditional digital chips spend enormous energy forcing transistors into precise 0/1 states, fighting thermal noise that tries to randomize them. Thermodynamic computing flips this: thermal noise becomes a resource (it generates your samples for free), and analog dynamics become your computation (equilibrium finding replaces iterative algorithms). The catch: you need hardware that’s precisely enough tunable to implement the energy landscapes you want, while noisy enough to actually sample correctly.

Framework Shift

Before (mainstream):                  After (this paper):

  +------------+                      +-------------------+
  | Software   |                      | Physical Hardware  |
  |            |                      |                   |
  |  Define    |                      |  Tunable energy   |
  |  model in  |                      |  potential        |
  |  code      |                      |  in circuit       |
  +------+-----+                      +--------+----------+
         |                                      |
         v                                      v
  +------+-----+                      +--------+----------+
  | Digital    |                      | Thermal noise     |
  | random     |                      | (free, physical)  |
  | number     |                      | drives Langevin   |
  | generator  |                      | dynamics          |
  +------+-----+                      +--------+----------+
         |                                      |
         v                                      v
  +------+-----+                      +--------+----------+
  | Simulate   |                      | Equilibrium       |
  | Langevin   |                      | reached by        |
  | steps in   |                      | actual physics    |
  | software   |                      | (not simulated)   |
  +------+-----+                      +--------+----------+
         |                                      |
         v                                      v
  +------+-----+                      +--------+----------+
  | Collect    |                      | Read statistics   |
  | samples    |                      | from analog       |
  | digitally  |                      | hardware readout  |
  +------+-----+                      +--------+----------+
         |                                      |
         v                                      v
  [~kW per inference]                  [~pJ per sample]

From software-simulated stochastic dynamics to hardware-native equilibrium sampling, the core shift is that the physics of the substrate becomes the computation itself, eliminating the energy cost of fighting noise and simulating randomness.

Expert Assessment

Problem choice: This is a real gap, not manufactured. Energy-efficient probabilistic inference is one of the genuine unsolved problems at the intersection of ML and hardware. The field has been circling this idea (Extropic, various physics-inspired startups, academic analog computing) without a rigorous academic blueprint. The paper fills that vacuum at the right moment — when transformer energy costs are headline news and the ML community is actively searching beyond digital scaling. That said, the paper sits closer to a research manifesto than a finished result, which is both its strength (ambitious scope) and weakness (limited empirical validation).

Method maturity: The theoretical framework is solid — the mapping from PGMs to energy potentials, the equilibrium-based differentiation, and the Langevin dynamics foundation are all well-grounded in prior theory. The clever move is the systematic composition: showing that existing ML architectures (RBMs, VAEs, diffusion models) can be expressed in this energy-potential language. However, the “method” is largely a blueprint rather than a tested system. The numerical simulations are illustrative but not exhaustive. The superconducting circuit prototype is a single experiment demonstrating thermal-noise-driven sampling, not a complete training pipeline. There’s a long road from “we showed the physics works for one simple case” to “we trained a useful model.”

Experimental integrity: The baselines and comparisons are mostly theoretical (analytical energy scaling arguments, simulation-based runtime estimates). The numbers are directionally compelling — orders-of-magnitude energy savings are plausible given that you’re replacing digital simulation with physical dynamics. But the experimental section is thin: one superconducting circuit demonstration showing basic stochastic behavior. Fair for a “blueprint” paper, but readers should not confuse this with a systems paper that delivers measured end-to-end performance.

Writing quality: The paper is well-structured and unusually clear for a hardware/physics/ML cross-disciplinary piece. The PGM framework for composing models is the strongest intellectual contribution and is well-explained. Where it cuts corners: the energy/runtime analysis section feels hand-wavy in places — the scaling arguments rely on assumptions (equilibrium reached quickly, readout costs negligible) that deserve more scrutiny. The experimental section reads like an appendix rather than a central pillar. If the authors had invested more in either (a) a detailed simulation study of a non-trivial model trained end-to-end, or (b) a more complete hardware prototype, the paper would be significantly stronger.

Verdict: weak accept — The blueprint is intellectually coherent and addresses a real gap, but the experimental evidence is too preliminary to fully validate the claims. Worth reading for anyone working at the ML-hardware interface.

Takeaways

1. Express your model as an energy landscape, not a probability distribution. The PGM-to-energy-potential mapping is transferable: even if you never build thermodynamic hardware, thinking about your model in terms of energy functions can simplify architecture design and make physics-inspired sampling algorithms more natural.

2. Consider what your hardware does “for free.” The paper’s core insight — that thermal noise is a resource, not a bug — generalizes: whenever you’re fighting the natural physics of your substrate (forcing analog to digital, fighting noise, simulating randomness), you’re likely burning energy unnecessarily. Ask: can I restructure my computation to *ride the physics rather than resist it?

3. Equilibrium-based differentiation is an underappreciated technique. The idea that you can differentiate through a system that has reached physical equilibrium (rather than through an explicit computational graph) has implications beyond thermodynamic computing — it connects to implicit differentiation, Deep Equilibrium Models, and physics-informed ML. If you work on any of these, the differentiation framework in this paper is worth studying.