MeanFlowNFT: Making Reward-Aligned Generation Fast with Average-Velocity Flows

Paper: 2607.15273 Authors: Yushi Huang, Xiangxin Zhou, Jun Zhang, Liefeng Bo, Tianyu Pang Categories: cs.CV, cs.LG

The Gap

Two powerful lines of work have matured in parallel but never properly shaken hands.

On the fast-sampling side: MeanFlow generators predict *average velocities over time intervals, collapsing what used to be 20-50 denoising steps into 1-4 steps. They’re fast and produce decent quality. But nobody has figured out how to align them with reward signals using RL.

On the RL-alignment side: DiffusionNFT introduced an elegant forward-process RL framework—no need to run reverse trajectories or estimate likelihoods. It optimizes a policy by directly updating instantaneous velocities using reward-weighted gradients. Works great for standard diffusion and flow models.

The clash: DiffusionNFT’s objective is defined on *instantaneous velocities. MeanFlow generates by predicting average velocities over intervals. You can’t just plug one into the other—the RL objective becomes ill-defined when your model doesn’t output the quantity the loss expects. Previous RL methods for few-step generators either required reverse-process trajectories (expensive, unstable) or weren’t designed for the MeanFlow parameterization at all.

The bridge: MeanFlowNFT exploits the *MeanFlow identity—a mathematical relationship that connects average and instantaneous velocities—to construct a synthetic instantaneous-velocity predictor. DiffusionNFT’s objective is applied to this predictor, making reward optimization well-defined. Sampling still uses the average velocity, so you keep the speed.

MeanFlow (fast)        DiffusionNFT (aligned)
avg velocity           instant velocity
       \                   /
        \                 /
  incompatible objectives
        |                 |
        v                 v
 MeanFlow Identity bridges them
        |                 |
        +-----> < --------+
              |
              v
    induced instant-velocity predictor
              |
              v
    DiffusionNFT loss applied here
              |
              v
    sampling still uses avg velocity
              |
              v
    fast + aligned = MeanFlowNFT

The Increment

One sentence: Before this paper, you had to choose between fast generation (MeanFlow) and reward alignment (DiffusionNFT-style RL); after this paper, you can have both simultaneously without sacrificing speed or alignment quality.

Core Mechanism

MeanFlowNFT has three moving parts that work together cleanly.

Part 1 — The MeanFlow model is a neural network that predicts the *average velocity u over a time interval [t, r]. Given a noisy sample x_t, it outputs u(x_t, t, r), which tells you how to move from time t toward time r on average. This is what makes few-step sampling possible: instead of integrating instantaneous velocities step by step, you jump across intervals.

Part 2 — The induced instantaneous-velocity predictor is constructed using the MeanFlow identity. The identity says: the instantaneous velocity v(x_t, t) can be recovered from the average velocity u by a specific formula involving the derivative of t**u with respect to t, plus a correction term. So even though the MeanFlow model doesn’t natively output instantaneous velocities, you can derive one from it. This derived predictor is never used for sampling—it exists purely to define the RL loss.

Part 3 — The DiffusionNFT objective is applied to this induced predictor. DiffusionNFT’s loss rewards instantaneous velocities that lead to high-reward samples, using a forward-process formulation (no reverse trajectories needed). The gradient flows back through the induced predictor into the MeanFlow model’s parameters. The model learns to generate high-reward outputs while keeping its average-velocity parameterization intact.

[MeanFlow Model]
  inputs: x_t, t, r
  outputs: avg velocity u
       |
       v
[MeanFlow Identity Transform]
  u -> induced instantaneous velocity v*
       |
       v
[DiffusionNFT Reward Loss]
  reward(x_0) weighted gradient on v*
       |
       v
[Backprop to MeanFlow params]
  updates u's weights
       |
       v
[Sampling still uses u directly]
  1-4 steps, fast generation preserved

The metaphor — a simultaneous translator with two personalities.

Imagine you have a translator who speaks in long, flowing paragraphs (that’s MeanFlow—the average velocity). A coach wants to give feedback on word choice, but the coach only understands individual words spoken one at a time (that’s DiffusionNFT—operating on instantaneous velocities).

The solution: you set up a real-time transcription system that breaks the translator’s flowing paragraphs into individual words on the fly. The coach critiques those individual words—this word is better, that word is worse. The critique feeds back to the translator, who adjusts how they speak in flowing paragraphs. Crucially, the translator never actually starts speaking word by word—they still deliver full paragraphs. The transcription was just a bridge for the coaching.

In this analogy:

• The translator = MeanFlow model
• Flowing paragraphs = average velocity
• Real-time transcription = the induced instantaneous-velocity predictor
• The coach = DiffusionNFT reward objective
• Critique = reward-weighted gradients
• The translator still speaking in paragraphs = sampling unchanged

Key Concepts

• Average vs. Instantaneous Velocity: Think of driving from A to B. Instantaneous velocity is your speedometer reading at any given second—it changes constantly. Average velocity is the total distance divided by total time—it’s one number for the whole trip. MeanFlow models learn to predict the “whole trip” velocity directly, which is why they can skip intermediate steps. Standard flow models predict the instantaneous velocity, requiring many small steps to integrate.

• The MeanFlow Identity: This is the mathematical trick that makes everything work. It’s a formula that says: if you know the average velocity u over [t, r], you can recover the instantaneous velocity v at time t by computing v = u + (r - t) ** (du/dt). It’s like saying: if you know your average speed for a 10-minute drive and how that average changes if you shorten the drive, you can figure out your exact speed at any moment. The paper uses this identity as a translator between MeanFlow’s language (average velocities) and DiffusionNFT’s language (instantaneous velocities).

• Forward-Process RL: Traditional RL for diffusion models requires running the reverse (generation) process, computing log-likelihoods, or estimating score functions—all expensive and unstable. Forward-process RL (from DiffusionNFT) sidesteps this entirely. It works in the *forward direction (adding noise, not removing it), where the training signal is cheap and stable. The insight: you don’t need to know how to trace back from a generated image to a noise vector; you just need to know how noise evolves forward and which forward trajectories lead to good outputs.

Framework Shift

Before (mainstream):                   After (this paper):

[Diffusion Model]                      [MeanFlow Model]
   uses instant velocity                  uses avg velocity
        |                                      |
        v                                      v
[DiffusionNFT RL]                      [MeanFlowNFT RL]
   reward alignment works                 instant velocity
        |                                 constructed via
        v                                 MeanFlow Identity
[Few steps = poor quality]                      |
   because instant velocity                     v
   needs many steps to                      [DiffusionNFT loss]
   integrate accurately                          |
                                                 v
                                          [avg velocity still
                                           used for sampling]
                                                 |
                                                 v
                                          [Few steps + aligned]

From instant-velocity RL requiring many steps to average-velocity RL preserving few-step speed, the core shift is using the MeanFlow identity as a bridge so you can optimize in instantaneous-velocity space while sampling in average-velocity space.

Expert Assessment

Problem choice: Real gap, well-motivated. MeanFlow is gaining significant traction as a practical generation paradigm, and the inability to apply RL alignment to it is a genuine blocker for anyone wanting reward-tuned fast generation. This sits squarely at the intersection of two active research threads—good positioning.

Method maturity: Clever, not brute force. The core insight—use the MeanFlow identity to construct an induced predictor—is elegant and principled. It’s the kind of thing that looks obvious in retrospect but wasn’t obvious before. The policy-improvement guarantee inherited from DiffusionNFT adds theoretical weight. One could ask whether there are simpler approximations that also work (e.g., just treating average velocity as approximately instantaneous and applying the loss directly), but the authors don’t address this ablation, which would strengthen the paper.

Experimental integrity: Strong. They test on both image (SD3.5-M) and video (Wan 2.1) generation, which is good coverage. The 4-step MeanFlowNFT on Wan 2.1 reaching 84.33 VBench vs. 50-step LongCat-Video RL at 82.57 is a compelling headline result—4 steps beating 50 is the kind of result that makes people pay attention. They report 6 of 8 metrics improved on SD3.5-M, which is honest (not cherry-picking all 8). Baselines include prior few-step RL methods. Minor concern: the Wan 2.1 comparison is against a different model architecture (LongCat-Video), so it’s not a pure apples-to-apples ablation—more like a system-level comparison. Fair for a headline, but worth noting.

Writing quality: The paper is reasonably well-structured. The connection between MeanFlow identity and the induced predictor is the key contribution and is explained with sufficient rigor. However, the related work section could be tightened—there’s some bloat that doesn’t directly serve the argument. The experiments section would benefit from a clearer “what we ablated” summary upfront rather than distributing insights across figure captions.

Verdict: weak accept — The contribution is genuine and the method is principled, but the novelty ceiling is moderate (it’s a well-executed combination of two existing ideas rather than a fundamentally new paradigm). The strong empirical results push it over the line.

Takeaways

The bridge-construction pattern: When you have a method that works on quantity A (instantaneous velocities) and another method that naturally produces quantity B (average velocities), don’t force one to speak the other’s language. Instead, find the mathematical identity that connects A and B, and build a thin conversion layer. This pattern—deriving a synthetic quantity purely for loss computation while keeping the original quantity for inference—likely transfers to other domains where training and serving objectives operate on different representations.

RL for fast generators is now on the table: If you’re working with few-step or distillation-based generators and want to align them with reward signals, this paper shows it’s feasible without sacrificing speed. The forward-process RL formulation avoids the instability of reverse-trajectory methods, and the MeanFlow identity trick makes it compatible with average-velocity parameterizations. If you’re building a system that needs both speed and alignment (e.g., real-time interactive generation), this is directly relevant.

Policy-improvement guarantees aren’t just decoration: The paper proves that MeanFlowNFT inherits DiffusionNFT’s monotonic improvement guarantee. This is worth stealing as a design principle: when building RL wrappers around generative models, structure your objective so that formal guarantees transfer. It’s not just about empirical results—it’s about knowing your method won’t diverge catastrophically.