Finite-Particle Convergence Rates for Conservative and Non-Conservative Drifting Models

Paper: 2605.22795 Authors: Krishnakumar Balasubramanian Categories: stat.ML, cs.AI, cs.LG, math.ST

The Gap

One-step generative models using displacement-based drifting (Deng et al., 2026) suffer from a fundamental non-conservatism issue: the velocity field is not a gradient field, meaning particles can circulate rather than converge to the target distribution. Existing finite-particle analysis for these methods lacks explicit convergence rates that account for the discrete nature of training data.

The paper addresses two boundaries: (1) theoretical — proving finite-particle convergence rates with explicit constants for both conservative and non-conservative drifting methods, and (2) methodological — replacing displacement velocity with a conservative KDE-gradient velocity that is provably a gradient field.

Problem: Displacement drifting is non-conservative
         (particles may circulate, not converge)
              |
              v
Assumption: KDE-smoothed scores form gradient field
              |
              v
Method: Replace displacement with (KDE data score - KDE model score)
              |
              v
Evidence: Finite-particle bounds with N^(-1/(d+4)) rate
          + explicit quadrature constants
              |
              v
Conclusion: Conservative method converges with controlled
            self-interaction term under local occupancy

The Increment

One sentence: Before this paper, one-step drifting methods lacked both conservatism guarantees and explicit finite-particle convergence rates; after, we have a conservative variant with provable N^(-1/(d+4)) convergence and explicit tracking of bandwidth-dependent constants.

Core Mechanism

The conservative drifting method replaces the original displacement velocity v(x) = E[X_data - x | x] with a KDE-gradient velocity. This new velocity is the difference between two kernel-smoothed score functions: ∇ log p_h(x) (data score) and ∇ log q_h(x) (model score), where p_h and q_h are kernel density estimates with bandwidth h.

The key insight is that this difference is itself a gradient field — specifically, the gradient of the log-ratio log(p_h/q_h). This conservatism means the velocity derives from a potential function, eliminating circulation and ensuring particles flow downhill toward the target distribution.

Data particles X_1,...,X_N  -->  KDE: p_h(x) = (1/N) sum K_h(x - X_i)
                                       |
                                       v
Model particles Y_1,...,Y_N -->  KDE: q_h(y) = (1/N) sum K_h(y - Y_j)
                                       |
                                       v
                        Velocity: v(x) = grad log(p_h/q_h)
                                       |
                                       v
                        Update: Y_t+1 = Y_t + eta * v(Y_t)

Think of this like water flowing on a landscape. The displacement method is like pushing water in the direction of nearby high ground — it might push you sideways around a hill rather than up it. The conservative method instead computes the actual slope of the landscape (the gradient) by smoothing out the terrain with a kernel, then flows directly uphill. The smoothing is crucial: raw empirical distributions are too spiky to differentiate reliably, but kernel smoothing creates a differentiable potential surface. The bandwidth h controls how much you blur the landscape — too much and you lose detail, too little and you get noise.

Key Concepts

• Kernel Density Estimation (KDE): Imagine you have scattered data points and want to draw a smooth probability density. KDE places a “bump” (kernel function) at each data point and averages them. For example, with N=3 points at positions 1, 2, 5 and Gaussian kernels with bandwidth h=1, the density at x=2 is roughly (1/3)[bump centered at 1 evaluated at 2 + bump centered at 2 evaluated at 2 + bump centered at 5 evaluated at 2]. The bandwidth h controls bump width: small h gives spiky densities that track individual points, large h gives smooth blobs that average over regions.

• Conservative vs Non-Conservative Vector Fields: A vector field is conservative if it’s the gradient of some scalar function (a potential). Conservative fields have no circulation — if you follow the arrows in a loop, you return to your starting height. Non-conservative fields can have vortices where following arrows in a circle takes you around and around. In generative modeling, conservative velocity means particles are guaranteed to flow toward equilibrium rather than circulate indefinitely.

• Finite-Particle Convergence: Most theory assumes infinite data (N → ∞). Finite-particle analysis asks: with exactly N training samples, how close does the model get to the target? The main correction term is self-interaction: when estimating density at a model particle’s location, that particle contributes to its own KDE, creating a 1/q_h(Y_i) term. Under good local occupancy (enough nearby particles), this term stays bounded and contributes an O(N^(-1/(d+4))) error rate.

Framework Shift

Before (displacement drifting):        After (conservative KDE-gradient):

Data X_i  Model Y_j                    Data X_i  Model Y_j
  *         o                             *         o
   \       /                               \       /
    \     /                                 \     /
     v = E[X-Y|Y]                            v = grad log(p_h/q_h)
     (direct push)                           (potential gradient)
         |                                       |
         v                                       v
    May circulate                           Flows to equilibrium
    (non-conservative)                      (conservative field)

One sentence: From pushing particles toward nearby data (which can create circulation) to flowing particles along the gradient of a smoothed log-density ratio (which guarantees convergence to a potential minimum).

Expert Assessment

Problem choice: Real gap. One-step generative models are gaining traction as alternatives to diffusion models, but the non-conservatism of displacement-based methods is a genuine theoretical concern. The finite-particle analysis is also timely — practitioners train on finite datasets, so asymptotic theory leaves a gap between theory and practice.

Method maturity: The conservative method is elegant but not surprising — using score differences is a natural fix once you identify the non-conservatism issue. The real contribution is the finite-particle analysis with explicit constants. However, the paper leans heavily on technical machinery (joint-entropy identities, quadrature regularity conditions) that may obscure whether simpler approaches exist. The Laplace kernel analysis for the non-conservative case feels like an afterthought to show the original method’s limitations.

Experimental integrity: This is a theory paper with no experiments. The bounds are proven rigorously, but there’s no empirical validation of whether the rates hold in practice or whether the conservative method outperforms the non-conservative one on real tasks. The local occupancy conditions are stated deterministically and probabilistically, but no guidance on when they hold for typical data distributions.

Writing quality: Dense and technical. The abstract packs too much notation into too little space. The main results (Theorems 3.1, 3.2) are stated with full generality but would benefit from a simplified special case first. The paper would be stronger if Section 4 (non-conservative analysis) were moved to an appendix and the main text focused on the conservative method with a concrete example worked through.

Verdict: weak accept — Solid theoretical contribution with explicit finite-particle rates, but lacks empirical grounding and accessibility. The conservative method is a clean fix to a real problem, but the paper doesn’t demonstrate whether it matters in practice.

Takeaways

For theorists: The joint-entropy identity technique for bounding Stein drift is reusable. The explicit tracking of quadrature constants and bandwidth dependence is a model for finite-sample analysis in other kernel-based methods.

For practitioners: If you’re implementing one-step drifting models, the conservative KDE-gradient velocity is a drop-in replacement that guarantees convergence. The key practical question (unanswered here) is bandwidth selection — too small and you get noise, too large and you lose signal. The N^(-1/(d+4)) rate suggests diminishing returns in high dimensions, which aligns with known curse-of-dimensionality issues in KDE.

For generative modeling researchers: The paper highlights a subtle issue in displacement-based methods that may not manifest in practice (if the non-conservative component is small) but is theoretically unsatisfying. The explicit finite-particle bounds give a principled way to think about sample complexity, though the constants likely hide large factors that make the bounds loose in practice.