Numbers as Words: FinATOM Turns Forecasting and Portfolio Allocation into Token Generation

Paper: 2608.09880 Authors: Xu Ouyang, Moontae Lee Categories: cs.CV, cs.LG

The Gap

Almost every financial LLM paper today has the same architecture smell: a language model reads news, filings, and price history, produces a hidden vector, and then hands that vector to a separate task-specific head. A linear regression head with MSE loss if you want returns. A learning-to-rank head (RSR, HIST, and descendants) if you want a cross-sectional stock ranking. A softmax policy head trained with PPO/DDPG if you want portfolio weights. The language model becomes a feature extractor, and the object you actually evaluate — a return number, a weight vector — lives outside the model’s own output space.

That split has three concrete costs. First, you cannot use the model’s own generative machinery (sampling, likelihood, constrained decoding) on the thing you care about. Second, every new task means a new head, a new loss, and a new training recipe, so nothing transfers. Third, and most annoying in practice, RL fine-tuning on a financial objective like Sharpe has to be plumbed through the head, not the tokens, which means all the modern LLM post-training tooling (GRPO, DAPO, and friends) doesn’t apply cleanly.

Prior work has nibbled at this. Chronos and Lag-Llama already showed you can quantize a time series into bins and forecast it as next-token prediction. Number-aware embedding schemes like xVal tried to make LMs handle magnitudes. But those are forecasting-only; nobody had asked whether a decision — a normalized, long-only, sum-to-one weight vector — can be emitted as tokens and then optimized against a realized risk-adjusted return with standard LLM RL. That is the boundary FinATOM pushes on.

   PROBLEM
   [ LM produces hidden vector -> external head produces
     the number you actually evaluate ]
        |
        | costs: no constrained decoding on the output,
        |        no task transfer, RL plumbed through head
        v
   ASSUMPTION
   [ a return, and a weight vector, can be *written down*
     in a discrete vocabulary without losing what matters ]
        |
        v
   METHOD (FinATOM, head-free)
        |
        +--> forecasting: emit volatility-standardized
        |    return tokens for t+1,t+2,t+3
        |      trained by: ordinal + ranking loss
        |      then: 1-epoch token-level policy stage
        |
        +--> allocation: emit 5 normalized long-only weights
             SFT imitates causal mean-variance anchor
             then: GRPO + DAPO on realized 21-day Sharpe,
                   constrained to stay near the anchor
        |
        v
   EVIDENCE
   [ 5-ETF, 2023-2025: gross Sharpe 1.428 > 1.529 ]
   [ net @ 5bp:              1.394 > 1.494 ]
   [ multimodal input: 3-period mean Sharpe 1.540 ]
   [ FinTexTS: 73.52% / 2.68 (SFT) vs 73.72% / 2.69 (RL) ]
        |
        v
   CONCLUSION
   [ "feasible" -- authors' own word -- not "better" ]
   [ deltas are real in sign, unproven in significance ]

The Increment

One sentence: Before this paper, an LLM that manages a portfolio needed a policy head bolted onto it; after this paper, there is a working demonstration that the weight vector itself can be a token sequence, which means the entire modern LLM post-training stack (GRPO, DAPO, reward shaping) can be pointed directly at realized Sharpe.

Core Mechanism

The forecasting side works like this. Raw returns are useless as a token vocabulary — a 2% move in a utility stock and a 2% move in a biotech are different events, and the scale of “typical” returns drifts with the regime. So FinATOM first divides returns by a trailing volatility estimate, producing standardized units where a token means roughly “one sigma up” rather than “two percent up.” Those standardized values are discretized into a token vocabulary, and the model emits three of them autoregressively for horizons t+1, t+2, t+3 — so the second-step forecast is conditioned on the first-step forecast, which is exactly the property you want and exactly what a three-output regression head can’t give you.

Training the forecaster has two ideas layered on plain next-token prediction. Cross-entropy over bins treats “predicted bin 7, truth bin 8” as exactly as wrong as “predicted bin 7, truth bin 30,” which is absurd for numbers, so an ordinal loss penalizes distance in bin space. And because most financial value comes from relative ordering rather than absolute levels, a ranking supervision term pushes the model to get cross-sectional order right. Then a short one-epoch policy stage at the token level nudges the distribution toward whatever downstream financial reward they define.

The allocation side is where the design gets interesting. The model generates five weights that must be non-negative and sum to one — a constrained decoding problem, not a regression problem. Rather than let RL loose on that (which in finance reliably discovers degenerate all-in-one-asset policies that happened to work in-sample), they do it in two stages: supervised fine-tuning first teaches the model to imitate a causal mean-variance optimizer, giving it a sane starting policy; then GRPO — with DAPO’s tricks for stabilizing group-relative advantages — optimizes realized 21-day Sharpe, but with an anchor-consistency constraint that keeps the policy from wandering far from the mean-variance solution. The RL stage is deliberately a perturbation, not a replacement.

  INPUT
  [ price history + text (news/filings) + optional chart images ]
        |
        v
  +---------------------------------------------+
  |        causal LM  (no task heads)           |
  +---------------------------------------------+
        |                              |
        v                              v
  FORECAST BRANCH               ALLOCATION BRANCH
        |                              |
  r / vol_hat                    constrained decode
  (standardize)                  w1..w5 as tokens
        |                        w_i >= 0, sum w_i = 1
  discretize to bins                   |
        |                              |
  emit z_(t+1)                   stage 1: SFT to imitate
        v                                 causal mean-variance
  emit z_(t+2) | z_(t+1)                   anchor
        v                              |
  emit z_(t+3) | z_(t+1),z_(t+2)  stage 2: GRPO + DAPO
        |                              reward = realized
  losses:                              21-day Sharpe
   + cross-entropy                     penalty = drift from
   + ordinal (bin distance)                      anchor
   + ranking (cross-section)           |
   + 1 epoch token policy              v
        |                        rebalance decision
        v
  z * vol_hat = return forecast

Here is the metaphor that makes it stick: FinATOM is a musician transcribing to sheet music instead of handing you an oscilloscope trace.

An external regression head is the oscilloscope — a continuous voltage readout, precise but living in its own instrument, unreadable by the orchestra. Sheet music is a discrete vocabulary: there are only so many notes on the staff. Volatility standardization is the key signature — you write the melody relative to the key so the same phrase transposes across instruments and eras; without it, a note means something different every month. The bins are the notes. The ordinal loss encodes that a semitone off sounds nearly right while an octave off is a mistake — standard cross-entropy is tone-deaf here, treating every wrong note as equally wrong. The ranking loss says what actually matters is the contour of the melody, whether this note is higher than the last, not its absolute frequency in hertz. Autoregressive three-step emission is playing the phrase forward: note two is chosen knowing note one was played.

The allocation model writes chords instead of a melody, and the constraint “weights sum to one” is the bar line — whatever you write, the durations must exactly fill one measure. SFT is learning to play the standard arrangement (mean-variance) from the score. GRPO is a jazz musician improvising around that arrangement, with the reward being how the room actually responded (realized Sharpe), and anchor consistency is the bandleader’s rule: you may ornament, but stay in the chord progression. That constraint is why the improvisation improves the performance modestly rather than derailing it — and also why the gains are small.

Key Concepts

• Head-free interface: Normally a model’s “answer” is produced by a final layer purpose-built for the answer’s shape — one number out for regression, a softmax over assets for allocation. Head-free means the answer is written in the same alphabet the model uses for everything else: tokens. Think of the difference between a calculator with a numeric display and a person writing “seven point three” on paper. The calculator is more precise; the writing is more composable, because you can put it in a sentence, constrain it grammatically, sample ten variants and compare, and grade the whole sentence with a reward model. FinATOM’s bet is that composability is worth more than the precision you give up to binning.

• Volatility standardization: Suppose you want one vocabulary of “move sizes” that works for a sleepy bond ETF and a jumpy tech ETF, in calm 2017 and violent March 2020. Absolute percentages fail: 1% is a huge day for the bond and noise for the tech name. So you divide each return by a recent estimate of that asset’s own typical move size. Now “+1.0” means “a one-sigma up day *for this thing, right now.” The model learns one universal grammar of surprise, and you multiply the volatility estimate back in at the end to recover a percentage. This is the single most load-bearing preprocessing decision in the paper — without it, the token vocabulary is incoherent across assets and regimes.

• Anchor-consistency-constrained GRPO: GRPO grades a batch of sampled outputs against each other — generate eight candidate weight vectors, see which produced better realized Sharpe, push toward the winners. On its own, in finance, this is a machine for finding lucky bets: with a few years of data, “100% in NVDA-heavy tech” wins the group tournament for reasons that will not repeat. The anchor constraint is a leash tied to a defensible classical solution (mean-variance): the reward can pull the policy, but a penalty term grows as it drifts from the anchor. The honest way to read the paper’s headline numbers is therefore “mean-variance, mildly and intelligently perturbed,” which also explains why the transaction-cost drag is tiny (1.529 gross to 1.494 net at 5bp implies low turnover — the policy isn’t thrashing).

Framework Shift

 Before (mainstream financial LLM):     After (FinATOM):

 [ text + prices ]                      [ text + prices + charts ]
        |                                       |
        v                                       v
 +----------------+                     +----------------+
 |  language model|                     | language model |
 +----------------+                     +----------------+
        |                                       |
   hidden vector h                       constrained decoding
        |                                       |
   +----+----+----+                             v
   v    v    v    v                     "0.31 0.12 0.05 0.28 0.24"
 [reg][rank][pol] heads                        (tokens)
   |    |    |                                  |
  MSE  BPR  PPO                          reward = realized
   |    |    |                            21-day Sharpe
   v    v    v                            via GRPO / DAPO
 3 tasks, 3 losses,                              |
 3 codebases, no transfer                        v
                                          one interface,
 RL must be plumbed                       one loss family,
 through the head                         RL acts on tokens

One sentence: from the model predicts features and a head predicts the answer to the model writes the answer in its own alphabet, the core shift is making the evaluated financial object a first-class citizen of the model’s output space, so that generic LLM post-training can optimize it directly.

Expert Assessment

Problem choice: Real gap, and well-placed on the field’s trajectory. The head-free / “everything is tokens” unification has already swept vision-language (Chameleon, unified autoregressive models) and time series (Chronos), and finance is the obvious next domain because its evaluated objects — returns, ranks, weights — are exactly the things people bolt heads on for. The specific contribution I’d credit as novel is not tokenized *forecasting (Chronos got there) but tokenized allocation under simplex constraints, optimized with GRPO on realized Sharpe. That combination I have not seen done cleanly, and it opens a door: if a portfolio decision is a token sequence, then every reward-shaping trick from RLHF is suddenly available to quant researchers.

Method maturity: Mostly clever, with one place where the cleverness is doing suspicious work. The genuinely good calls are volatility standardization (makes the vocabulary transferable), ordinal + ranking losses (the right fix for the tone-deafness of cross-entropy over ordered bins), and the SFT-to-anchor-then-constrained-RL curriculum, which is exactly the discipline financial RL usually lacks. The suspicious part is that the anchor constraint is load-bearing in both directions: it prevents the failure mode *and caps the upside, so the paper can never really distinguish “our RL found signal” from “our RL added a small amount of noise-shaped drift to Markowitz that happened to help in this window.” A simpler baseline is also conspicuously underexplored: quantile regression heads on the same features would give you distributional forecasts without any tokenization, and I’d want to see that head-to-head before accepting that head-free is worth the discretization loss.

Experimental integrity: This is where I’d push back hardest, and to their credit the authors partly pre-empt it by asking for “broader tests across assets, regimes, and random seeds” in the abstract itself. The problem is arithmetic. The standard error of a Sharpe estimate is roughly sqrt((1 + S²/2)/T) in years; with S ≈ 1.5 and T ≈ 3 years, that is about 0.7. The headline improvement is 0.10. The gain is *seven times smaller than the noise floor of the metric it’s measured in. Five ETFs over 2023–2025 is one regime — a strong equity bull with a bond selloff — and “clearest advantage in 2025” on a single year is essentially an anecdote. On FinTexTS, SFT gets 73.52%/2.68 and the policy stage gets 73.72%/2.69; that 0.20pp difference is a rounding artifact, and reporting it as if the RL stage helped is the kind of thing reviewers should call out. Two further gaps: the abstract never reports the anchor’s own Sharpe, so we cannot tell whether the SFT model matched, beat, or merely approximated the mean-variance optimizer it imitated — which is the single most important number in the paper. And a Sharpe of 2.68 on FinTexTS should trigger immediate look-ahead-bias questions about how the text data is timestamped relative to the returns being predicted. The cs.CV listing with only a passing mention of “multimodal allocation input” also suggests the chart-image modality is thin — and it’s the component credited with the best mean Sharpe (1.540), so it deserves far more than a clause.

Writing quality: The abstract is unusually honest about its own limits, which I respect and which is rarer than it should be. But honesty in the abstract doesn’t substitute for statistics in the results section. If I could force one rewrite it would be the evaluation: add seed variance, add block-bootstrap or Ledoit–Wolf confidence intervals on the Sharpe differences, report the anchor baseline explicitly, extend to a pre-2023 period that includes 2022’s drawdown, and demote the FinTexTS RL-vs-SFT comparison to “indistinguishable.” That single section, done properly, moves this from a feasibility note to a paper people cite. The other soft spot is the tokenization ablation: how many bins, how much information is lost, does performance degrade gracefully as the vocabulary coarsens? That’s the question a reader most wants answered and the abstract doesn’t hint that it’s addressed.

Verdict: borderline / weak accept — the interface contribution is genuinely useful and likely to be built on, but the empirical claims are currently indistinguishable from noise and the framing leans on differences the data cannot support.

Takeaways

Things worth stealing, in rough order of transferability:

Volatility standardization before discretization is the generalizable trick, and it isn’t about finance. Any time you tokenize a continuous quantity that varies in scale across entities or over time — sensor readings across device types, latencies across services, click rates across regions — normalize by a local scale estimate first so a token means the same thing everywhere, then multiply the scale back at decode. Skipping this is why naive time-series tokenization often underperforms.

Ordinal loss over ordered bins should be a reflex, not an insight. If your vocabulary has a natural order, plain cross-entropy is throwing away the geometry of your own label space. Cheap to add, and it shows up anywhere you’ve quantized a regression target into classes.

SFT-to-a-classical-anchor, then constrained RL is the right template for any domain where RL on a noisy reward will happily find degenerate solutions. Imitate a defensible non-learned baseline first so the initial policy is sane; then let RL improve it with a penalty for drifting from that baseline. You get bounded downside and interpretable behavior, at the cost of bounded upside. Applies well beyond portfolios — resource allocation, bidding, control problems with a known decent heuristic.

Constraints as decoding rules rather than architecture. Needing outputs to be non-negative and sum to one usually means a softmax head. Doing it via constrained decoding instead means the constraint is enforceable at inference on a model you didn’t design for the task, and you keep sampling and likelihood. Worth remembering the next time you’re tempted to add a head.

A calibration habit, not from the paper but for reading papers like it: memorize sqrt((1 + S²/2)/T) as the rough standard error of a Sharpe ratio. It takes ten seconds and it tells you whether a backtest improvement is a result or a coincidence. In this paper, it says coincidence — which doesn’t invalidate the architecture, but does mean the right claim is “this works at all,” which is what the authors, to their credit, actually wrote.