Train Classical, Deploy Quantum: A Converged Loss Is Not Generalization

Paper: 2608.31117 Authors: Snehal Raj, Natansh Mathur, Alejandro Perdomo-Ortiz Categories: quant-ph, cs.LG

The Gap

Quantum generative models have an appealing property: a quantum circuit naturally produces samples from the distribution it encodes, and for suitable circuits that distribution is believed to be hard for any classical computer to reproduce. Both facts point the same way — sampling is where the quantum device earns its keep.

That suggests a division of labour. Train on a classical computer, deploy on the quantum device. The strategy is possible whenever the training loss can be evaluated classically, and a prime example is the maximum mean discrepancy (MMD²) — a moment-matching loss that compares model and data through their Pauli-Z correlations. Two moments can be computed from a circuit’s output on a classical simulator, so the whole training loop stays classical.

Research so far has asked two questions: whether such models can be trained, and whether their sampling is hard. A third question, the one that decides whether the pipeline is useful, has been left poorly understood: does minimising such an objective yield a model that generalises, rather than one that merely reproduces the training statistics?

The distinction is the whole problem. A moment-matching loss is a proxy for matching a distribution, and matching a proxy can be achieved exactly while missing the distribution. Whether that happens is an empirical question about the objective, not a theorem about circuits.

   WHY "TRAIN CLASSICAL, DEPLOY QUANTUM" IS APPEALING

   quantum circuit NATURALLY samples from the distribution
     it encodes
   for suitable circuits that distribution is BELIEVED HARD
     for any classical computer to reproduce
        |
        v
   -> SAMPLING is where the quantum device earns its keep
   -> so: TRAIN on a classical computer, DEPLOY on the device
        |
        v
   POSSIBLE WHEN the training loss is classically evaluable
     prime example: MAXIMUM MEAN DISCREPANCY (MMD^2)
       a MOMENT-MATCHING loss comparing model and data
       through their PAULI-Z CORRELATIONS
       -> computable on a classical simulator
       -> the whole training loop stays classical

   QUESTIONS ASKED SO FAR
     [asked] can such models be TRAINED?
     [asked] is their SAMPLING hard?
     [NOT answered] does minimising it GENERALISE -- or does it
                    merely REPRODUCE the training statistics?
        |
        v
   [GAP] a moment-matching loss is a PROXY for matching a
         distribution; matching a proxy can be achieved
         EXACTLY while missing the distribution

The Increment

One sentence: Before this paper, it was unclear whether a converged moment-matching loss implies generalization for quantum generative models; after it, benchmarking by direct sampling shows those models generally generalise worse than likelihood-trained ones, on two application-inspired datasets.

Core Mechanism

The method is a direct comparison by direct sampling — that is, generate samples from each trained model and evaluate the resulting distributions, rather than trusting the training objective. That choice is the design’s core, and it is the correct response to the gap: if the worry is that a converged proxy loss may not imply a good distribution, the only way to answer it is to look at the distribution.

The comparison is a broad set of quantum and classical generative models, so the finding is about the objective rather than about one architecture. And the result is stated plainly: models trained with a moment-matching loss generally show worse generalization than the likelihood-trained models.

That phrasing matters — “generally” rather than “always” — and it locates the problem precisely. It is not that moment matching cannot work; it is that the objective does not reliably deliver what a likelihood-trained model does. Since MMD² is exactly the kind of loss that makes the train-classical strategy possible, the finding bears directly on the practicality of that strategy.

Two datasets carry the claim, both chosen to resemble applications rather than to be convenient:

• A cardinality-constrained dataset at up to 30 qubits. Cardinality constraints — distributions supported on subsets of a given size — are structurally interesting because the constraint is a property of which configurations are valid at all, not of how probable each one is.
• A dataset of genomic single-nucleotide variants, whose valid set is the observed data. This is the sparse-data regime: the set of valid outputs is the data itself, so a model that memorises the training statistics has little to generalise to and a proxy loss has no slack to hide in.

The conclusion is stated with the right scope, and the honesty is in what it leaves open. A converged moment-matching loss is not a reliable measure of generalization, so train-classical deploy-quantum workflows will need approaches that target generalization directly. And then the admission: it remains open whether better training objectives suffice or whether the model architectures themselves must change. That refusal to prescribe is appropriate, because the experiment identifies the problem’s location rather than its remedy.

   METHOD: COMPARE BY DIRECT SAMPLING

   train a BROAD SET of quantum AND classical generative models
        |
        v
   take samples DIRECTLY from each trained model
   (do NOT trust the training objective -- that is the point)
        |
        v
   RESULT: moment-matching loss models GENERALISE WORSE
           than likelihood-trained models
     "generally", not "always" -> the OBJECTIVE does not
       reliably deliver what likelihood training does
        |
        v
   TWO APPLICATION-INSPIRED DATASETS
     [1] cardinality-constrained, up to 30 qubits
           the constraint is on WHICH configurations are valid
           at all, not on how probable each is
     [2] genomic single-nucleotide variants,
           VALID SET = the observed data
           <- sparse-data regime: a memoriser has little
              to generalise to, and a proxy loss has no
              slack to hide in

   CONCLUSION
     a converged moment-matching loss is NOT a reliable
       measure of generalization
     -> train-classical deploy-quantum workflows need
        approaches that target generalization DIRECTLY
     OPEN: do better training OBJECTIVES suffice, or must
           the model ARCHITECTURES themselves change?

Think of it as judging a portrait by the measurements rather than the likeness. You can specify the subject’s proportions — the distance between the eyes, the length of the nose, the width of the jaw — and a painter can match every one of those numbers exactly while producing something that resembles nobody. The numbers are a real proxy: getting them right correlates with a good portrait, and a painter who ignores them will usually do worse. But converging on the measurements is not the same as capturing the face, and if your workflow only lets you compare measurements — as a classically computable loss requires — then you will not notice the difference until you look at the finished picture next to the sitter. That is what “compare by direct sampling” does here, and what it finds is that the measurement-converged models look less like the data.

Key Concepts

• The moment-matching proxy problem: MMD² compares model and data through Pauli-Z correlations, which makes training classically computable but means the objective is a stand-in for the distribution rather than the distribution. Converging on a proxy and matching a distribution are different achievements.
• Direct sampling as the evaluation: generating samples and assessing the resulting distribution instead of reading the training objective. It is the only method that can answer the question posed, since the question is precisely whether the objective is informative.
• Sparse-data regimes exposing memorisation: the genomic variant dataset, where the valid set is the observed data. A model that reproduces training statistics has nothing to generalise to, which is why this dataset makes a proxy loss’s failure visible rather than hidden.
• Locating the problem without prescribing the remedy: the conclusion that moment matching is not a reliable generalization measure, while leaving open whether better objectives suffice or architectures must change. It is the honest scope for an experiment that identifies where the difficulty sits.

Framework Shift

Before (train on the proxy, trust the loss):
  classically computable moment-matching loss (MMD^2)
  -> train classically, deploy on the quantum device
  -> convergence of the loss treated as success
  -> "can it be trained" and "is sampling hard" were asked;
     "does it generalise" was not answered

After (evaluate by direct sampling):
  sample directly from quantum AND classical models
  -> moment-matching models GENERALISE WORSE than
     likelihood-trained ones
  -> on a 30-qubit cardinality task and a genomic variant set
  -> a converged moment-matching loss is NOT a reliable
     measure of generalization

From treating a converged proxy loss as evidence of a good model, to judging the generated distribution directly, the core shift is that a training objective which is classically convenient may be measuring something other than what the deployment needs.

Expert Assessment

Problem choice: Excellent, and it asks the question the pipeline’s practicality depends on. The literature on quantum generative models has been organised around trainability and sampling hardness — both real questions, both about feasibility — while the question that decides whether anyone should deploy such a model was left open. Naming a proxy-versus-distribution gap as the issue is the right diagnosis.

Method maturity: The design follows directly from the question: if the worry is that the objective misleads, then evaluate by sampling rather than by loss. Comparing a broad set of quantum and classical models means the finding attaches to the objective rather than to a particular circuit family, which is what makes it useful. The dataset choices are well motivated — cardinality constraints test a structural validity condition, and the genomic variant set is a sparse regime where memorisation is hard to conceal.

Experimental integrity: The scoped conclusion is the strongest feature. Saying that moment matching “generally” generalises worse, rather than that it fails, and then declining to prescribe whether objectives or architectures must change, matches what the experiment establishes. The main limitation is that the benchmark is generative-model quality on two datasets rather than a characterization of why the objective falls short — a mechanism would make the prescription easier, and the paper is content to leave that to follow-up work.

Writing quality: The abstract leads with the appeal of the pipeline before the problem, which makes the finding land as a complication rather than as a dismissal. Since the conclusion is partly negative, one concrete comparison — the same distribution under a moment-matching and a likelihood-trained model, side by side — would make the failure visible in a way the aggregate statement cannot.

Verdict: strong accept — it tests the assumption the train-classical deploy-quantum strategy rests on, finds it does not hold in general, and states the limits of what it has shown.

Takeaways

• Evaluate a generative model by sampling it, not by its training loss. If the objective is a proxy, convergence tells you about the proxy.
• Check whether your loss can be gamed in principle. A moment-matching loss can be matched exactly while missing the distribution, so convergence is not evidence of a good model.
• Prefer datasets where memorisation has nowhere to hide. A regime whose valid set is the observed data will expose a proxy objective that a denser dataset would conceal.
• Distinguish “can be trained” from “should be deployed” when assessing a hardware pipeline. Trainability and sampling hardness are feasibility questions; generalization is the deployment question.