Integrable Elasticity via Neural Demand Potentials

Paper: 2605.22820 Authors: Carlos Heredia, Daniel Roncel Categories: cs.LG

The Gap

Retail demand modeling faces a fundamental tension: we want to predict sales (demand-first) but also need price elasticities for decision-making. Traditional econometric models estimate elasticities directly but struggle with high-dimensional product spaces and context dependence. Recent neural approaches predict demand well but derive elasticities as afterthoughts—taking numerical derivatives of black-box networks yields noisy, economically implausible estimates, especially for cross-price effects where data is sparse.

The core problem: elasticity is a derivative, but neural networks aren’t designed to have well-behaved derivative structure. You can differentiate a neural net, but nothing guarantees the resulting elasticities will be smooth, symmetric where theory demands, or stable across similar contexts.

Problem: Need both accurate demand forecasts AND stable elasticities
   |
   v
Prior approaches split into two camps:
   |
   +---> Econometric models: Theory-driven elasticities
   |        |
   |        +---> Limitation: Poor fit in high dimensions
   |
   +---> Neural demand models: Flexible predictions
            |
            +---> Limitation: Noisy elasticity derivatives
   |
   v
This paper's insight: Learn demand as gradient of a potential
   |
   v
Method: Neural network outputs potential function Φ(p, context)
        Demand = ∇_p Φ  (gradient w.r.t. log-prices)
   |
   v
Evidence: Dominick's beer dataset (multi-product retail)
   |
   +---> Better out-of-sample demand prediction
   +---> More stable cross-price elasticities
   +---> Economically plausible substitution patterns
   |
   v
Conclusion: Integrable structure improves both prediction and interpretation

The Increment

One sentence: Before this paper, neural demand models treated elasticities as numerical derivatives of predictions; after, elasticities are exact derivatives of a learned potential function, making them smooth and economically interpretable by construction.

Core Mechanism

The ICDN architecture inverts the typical neural demand pipeline. Instead of learning a function that maps (prices, context) → demand, it learns a scalar potential function Φ(log-prices, context). Demand is then defined as the gradient of this potential with respect to log-prices. This seemingly small change has profound implications: gradients of smooth functions are automatically smooth, and the potential structure enforces integrability constraints that align with economic theory.

The network takes log-prices and contextual features (store, time, promotions) as input, processes them through standard neural layers, and outputs a single scalar—the potential. During training, the model computes ∇Φ to get predicted log-demand and compares it to observed log-demand. Crucially, elasticities are never explicitly supervised; they emerge as second derivatives ∇²Φ, inheriting smoothness from the potential’s learned structure.

The architecture uses automatic differentiation to compute these derivatives efficiently. At inference time, you get both demand predictions (first derivatives) and elasticity estimates (second derivatives) from a single forward pass plus gradient computation. The potential acts as a regularizer: it can’t produce arbitrary elasticity patterns because all elasticities must be consistent with some underlying scalar field.

Input: log-prices p, context c
   |
   v
[Neural Network Φ_θ]  <--- Learns scalar potential
   |
   v
Potential: Φ(p, c) ∈ R
   |
   +---> ∂Φ/∂p_i = q_i  (demand for product i)
   |
   +---> ∂²Φ/∂p_i∂p_j = ε_ij  (elasticity i w.r.t. price j)
   |
   v
Loss: ||q_predicted - q_observed||²
      (only supervise demand, elasticities come free)

Think of it like a topographic map. Traditional neural demand models try to learn the altitude at every point directly—they memorize elevations. This approach learns the underlying terrain as a smooth surface (the potential). Once you have the terrain, slopes (demand) and curvature (elasticities) follow automatically and must be consistent with each other. You can’t have a slope pointing north at one spot and south at a nearby spot without the terrain being curved in a specific way. The potential enforces this geometric consistency.

When you ask “how does demand for beer A change when beer B’s price increases?”, you’re asking about terrain curvature. The potential guarantees that if you walk from point (p_A, p_B) to (p_A, p_B + δ), the change in slope you experience is smooth and consistent with the overall landscape. Traditional models learn slopes independently at each point, so nearby slopes can contradict each other—you get elasticity estimates that flip sign or explode in magnitude for no economic reason.

Key Concepts

• Integrability: In economics, demand functions should ideally come from utility maximization, which means they’re gradients of some underlying preference structure. Mathematically, this means the demand system is “integrable”—there exists a potential function whose gradient gives you demand. Most flexible models (including neural nets) don’t guarantee this. ICDN enforces it by construction: since demand is literally defined as ∇Φ, it’s integrable by definition. This isn’t just mathematical elegance; it rules out economically nonsensical patterns like circular substitution chains (A substitutes for B, B for C, C for A) that violate revealed preference.

• Log-log specification: The model works in log-space: log-demand as a function of log-prices. This is standard in demand modeling because elasticities become simple derivatives (∂log q / ∂log p = elasticity), and it naturally handles the multiplicative structure of demand (prices and quantities span orders of magnitude). The log-log form also makes the potential interpretation cleaner: Φ becomes something like a “log-utility” function, and its gradients give percentage changes rather than absolute changes.

• Context conditioning: The potential Φ isn’t just a function of prices—it’s conditioned on context (store characteristics, time, promotions). This means the entire demand surface can shift and deform based on context. A promotion doesn’t just shift demand for one product; it reshapes the entire elasticity landscape. The neural network learns how context modulates the potential’s shape, allowing elasticities to vary in economically meaningful ways (e.g., substitution patterns differ between discount and premium stores).

Framework Shift

Before (directed demand model):        After (potential-based model):

  [Prices, Context]                      [Prices, Context]
         |                                       |
         v                                       v
  +-------------+                         +-------------+
  | Neural Net  |                         | Neural Net  |
  +-------------+                         +-------------+
         |                                       |
         v                                       v
    [Demand q]                            [Potential Φ]
         |                                       |
         v                                       +---> ∇Φ = Demand q
  Elasticity ε ≈ Δq/Δp                          |
  (numerical derivative,                        +---> ∇²Φ = Elasticity ε
   noisy, inconsistent)                         (exact derivative,
                                                  smooth, consistent)

One sentence: From learning demand directly and approximating elasticities numerically, to learning a potential function where demand and elasticities are exact, consistent derivatives.

Expert Assessment

Problem choice: This is a real gap at the intersection of machine learning and econometrics. Retail pricing decisions require elasticity estimates, and existing neural approaches genuinely struggle with cross-price effects. The problem sits in a sweet spot: economically important, technically tractable, and underexplored. Not groundbreaking in scope, but honest and well-motivated.

Method maturity: The core idea—parameterizing demand via a potential—is elegant and draws on established theory (integrability from microeconomics, energy-based models from ML). The execution is straightforward: standard neural architecture with automatic differentiation. No architectural tricks or hyperparameter magic. The simplicity is a strength; this could have been done five years ago but wasn’t. That said, the paper doesn’t explore architectural choices deeply (network depth, activation functions, regularization schemes). It’s a proof of concept, not an exhaustive study.

Experimental integrity: The Dominick’s beer dataset is a reasonable testbed—real retail data with multiple products and price variation. The baseline (directed log-log model) is fair but minimal; comparisons to econometric benchmarks (AIDS, Rotterdam) or other neural approaches would strengthen claims. The elasticity stability results are compelling but qualitative (visual inspection of elasticity matrices). Quantitative metrics for elasticity plausibility (symmetry violations, sign consistency) would be more convincing. The out-of-sample improvement is modest, suggesting the main value is interpretability, not raw prediction.

Writing quality: The paper is clear and well-structured, but the related work section undersells connections to energy-based models and implicit differentiation in ML. The experimental section could use more ablations: how sensitive is performance to potential architecture? Do different activation functions affect elasticity smoothness? The discussion of economic plausibility is hand-wavy—specific examples of implausible elasticities from the baseline vs. plausible ones from ICDN would be more persuasive than general claims.

Verdict: weak accept — Solid idea with clear motivation and reasonable evidence, but experimental scope is narrow and the contribution is incremental rather than transformative.

Takeaways

For ML practitioners: The potential function trick generalizes beyond demand modeling. Anytime you need to predict a quantity and its derivatives (e.g., force fields in physics, gradients in optimization landscapes), learning the potential instead of the quantity directly can improve derivative quality. The key insight: derivatives of smooth functions are smoother than finite differences of noisy predictions.

For economists/pricing analysts: This shows neural networks can respect economic structure without sacrificing flexibility. If you’re building demand models for pricing or assortment optimization, the potential formulation gives you elasticities you can actually trust for downstream decisions. The context-conditioning is particularly useful for heterogeneous markets.

For researchers: The paper demonstrates that imposing structure (integrability) can improve both prediction and interpretation. This is a template for “theory-informed neural models”—use domain knowledge to constrain architecture, not just loss functions. The approach is underexplored in other economic domains (production functions, cost curves, auction bidding).