Correcting a Learned Invariant: World Models Know Physics They Still Violate

Paper: 2608.23526 Authors: Richard Bao Categories: cs.AI

The Gap

World models are judged largely by whether the video they predict looks right. That is a behavioural criterion, and it leaves an important question unasked: does the model’s internal dynamics preserve the physical structure of the system, or does it merely produce plausible frames?

The distinction matters because a model can learn a physical constraint from pixels and still violate it while imagining forward. Fitting the data does not require that the latent transition respect the structure it has discovered — and if it does not, then long-horizon rollouts will drift in ways that short-horizon prediction error will never reveal.

Before that failure can even be probed, there is a measurement problem. How do you tell a dynamically meaningful invariant — a quantity the model’s own transition actually treats as conserved — from a merely decodable correlate, a scalar you can read out of the latent state that merely happens to be correlated with something physical? A readout that predicts energy is not evidence that the model’s dynamics conserve energy.

   HOW WORLD MODELS ARE EVALUATED
   predict video -> does it look right? -> accept
        |
        v
   [UNASKED] does the latent transition PRESERVE
             the physical structure it learned?
        |
        v
   A model can:
     learn a constraint from pixels        (data-fitting: yes)
     AND violate it during forward imagination
        |
        v
   [MEASUREMENT PROBLEM, prior to any of that]
   dynamically meaningful invariant   vs   decodable correlate
   "the transition treats it as           "a scalar you can read
    conserved"                             out that correlates"
        |                                       |
        +------------------+--------------------+
                           v
   [GAP] no separation, so no way to test whether
         the dynamics respect the physics

The Increment

One sentence: Before this paper, a readout that predicted a physical quantity was treated as evidence the model had learned that physics; after it, a label-free search separates genuinely conserved quantities from decodable correlates, and shows the model drifts off them during rollout while the drift is cheaply correctable.

Core Mechanism

The setup is deliberately minimal, which is what makes the findings attributable. A frozen DreamerV3 trained only on pendulum video — a conservative system, nothing else. And matched damped models as controls, which is the design decision that carries the argument: a damped pendulum looks very similar in video but is not conservative, so any search that finds the same quantity in both is finding a correlate rather than an invariant.

The label-free search. The method looks for a scalar that the model’s own latent transition treats as approximately conserved, without being told what to look for. The results are the crux:

• It recovers the same energy-like invariant across independently trained conservative models. Independently trained models, same recovered quantity, is what “dynamically meaningful” means here.
• The same procedure finds no comparable invariant in the matched damped models. This is the control doing its job: the search is not simply returning whatever scalar is easiest to extract.

So the model did learn something real, in a sense that survives a test designed to falsify it. That establishes the premise. The failure comes next.

During autonomous rollouts, the quantity drifts. The model’s dynamics do not conserve the very quantity they approximate as conserved. This is the concrete failure mode the paper is after: physical structure learned from pixels, then violated in imagination. Notably, this is invisible to the ordinary evaluation criterion — the frames can still look fine while the invariant slides.

Projecting the latent state back toward its initial level set reduces rollout error in all three conservative models. This is the correction, and it is the paper’s constructive result. It is also a small, surgical intervention: no retraining, no added loss during training, just a projection applied during rollout. And the control for it is the right one — matched random constraints usually increase the error, so the improvement comes from the projected quantity being the right one, not from projecting as such.

   EXPERIMENT AND FINDINGS

   [ frozen DreamerV3, trained ONLY on pendulum video ]
     + matched DAMPED models as controls
                 |
                 v
   [1] LABEL-FREE SEARCH for a scalar the latent
       transition treats as approximately conserved
        |
        +-- conservative models: SAME energy-like
        |                        invariant recovered
        |                        (independently trained)
        +-- damped models:       NO comparable invariant
        |
        v
   [2] AUTONOMOUS ROLLOUT
       the quantity DRIFTS  ->  dynamics violate the
                                constraint they learned
       (invisible to "do the frames look right?")
        |
        v
   [3] CORRECTION: project latent state back toward
       its initial level set
        -> rollout error DOWN in all 3 conservative models
        -> matched RANDOM constraints usually RAISE error
           (so the right quantity matters, not projection)

Think of it as a student who has clearly learned the conservation law and then makes an arithmetic slip in the middle of solving. You can see they know the rule — ask them what is conserved and they will tell you, and the fact that the same answer comes from several students who studied independently, but not from students who studied a system where it is not conserved, tells you they learned the actual law rather than a coincidental pattern. Yet over a long problem their numbers drift off it. The useful response is not to re-teach the law. It is to hand them a check: at the end of each step, confirm the conserved quantity matches where it started, and nudge back if it does not. That is precisely the projection this paper applies, and the fact that an arbitrary check does not help — only the correct conserved quantity does — is what confirms the check is catching something real.

Key Concepts

• Dynamically meaningful invariant versus decodable correlate: the distinction the paper’s search method operationalises. A scalar read out of a latent state that correlates with energy is not evidence of conserved dynamics; a scalar the transition itself approximately preserves is. Only the second licenses the claim that the model learned the physics.
• Matched damped controls: models trained on a visually similar but non-conservative system. They are what turn “the search found an energy-like quantity” into evidence, because a search returning a correlate would have found one here too.
• Rollout drift as an evaluation blind spot: the model violates its own learned constraint during forward imagination, while frame-level prediction quality looks acceptable. It is a failure mode that only invariant-level measurement exposes, which is the argument for measuring invariants at all.

Framework Shift

Before (behavioural evaluation):
  train world model -> predict video -> looks right -> good
  check for physics by READING OUT a quantity
  -> a readout that predicts energy is taken as
     evidence the dynamics conserve energy

After (invariant-level evaluation and correction):
  label-free search for what the TRANSITION preserves
  -> conservative: same invariant across independent runs
  -> damped:       none found  (control passes)
  -> rollout:      the invariant DRIFTS
  -> correct by projecting onto the initial level set
                   (random constraints do not help)

From asking whether the predicted video looks right to asking whether the dynamics preserve the structure they represent, the core shift is evaluating a world model by the invariants its transition respects rather than by the plausibility of its frames.

Expert Assessment

Problem choice: Very good, and it is the right kind of narrow. Long-horizon rollout quality is the property practitioners actually depend on, and the paper isolates a specific, falsifiable way it can fail — a violated internal constraint — rather than reporting another aggregate error metric.

Method maturity: The label-free search plus matched damped controls is a genuinely well-constructed argument, and it is the part that elevates this from an observation to a measurement. The projection correction is attractively cheap: no retraining, no training-time penalty, applied only at rollout. The scope is the honest limitation. A pendulum is a one-dimensional conservative system; whether the same search finds and corrects meaningful invariants in high-dimensional, partially observed, contact-rich domains is the open question, and the single-system evidence base does not settle it.

Experimental integrity: The controls are the strength, and they are used where they matter. Independently trained conservative models recovering the same quantity, damped models yielding nothing comparable, and random constraints failing to improve rollout error together make a tight argument that the quantity is both real and the relevant one. The main caveat is that “approximately conserved” carries a threshold, and the paper’s conclusions depend on how that threshold is chosen; a sensitivity analysis on it would strengthen the claim considerably.

Writing quality: The paper is short and each step follows from the last, which suits a focused result. The most valuable addition would be a concrete number: how much rollout error the projection removes, and over what horizon, since that is what a practitioner needs to judge whether the correction is worth adopting.

Verdict: accept — a clean, well-controlled demonstration that a world model can learn a constraint and violate it during imagination, with a cheap correction and an honest account of how narrow the evidence is.

Takeaways

• Do not infer that a model’s dynamics respect a physical law because you can read that quantity out of its latent state. Test what the transition preserves, ideally against a control that does not conserve it.
• Evaluate world models at the invariant level, not only the frame level. Drift in a conserved quantity is invisible to “does the prediction look plausible”.
• Try projection onto a known invariant before retraining. Here it cut rollout error with no training-time change — and the fact that random constraints did not help confirms the quantity was the reason.
• Check whether your “approximately conserved” threshold is load-bearing. Invariant-based claims are only as strong as the tolerance that defines them.