Uncertainty as an Input, Not an Afterthought: LLM Sentiment Meets Small-Cap Portfolio Construction

Paper: 2608.12283 Authors: Alireza Kargarzadeh, Nariman Khaledian, Navid Parvini, Arman Khaledian Categories: q-fin.PM, cs.CL

The Gap

The “LLM reads the news, LLM picks the stocks” literature has moved fast and shallowly. The typical pipeline looks like this: scrape headlines, ask an LLM for a sentiment score or a return forecast, rank stocks by that score, then hand the ranking to a portfolio optimizer. The LLM’s output touches exactly one slot in the mean-variance problem — the expected return vector. Risk gets estimated the old way, from a rolling window of historical covariances, as if the model had no opinion about how confident it was.

That’s the boundary. Two specific shortcomings follow from it.

First, the model’s confidence is thrown away. An LLM that reads a vague earnings pre-announcement and one that reads a signed acquisition agreement may output the same sentiment score with wildly different reliability. Prior work either ignores this or, at best, shrinks the expected return toward zero when confidence is low. Shrinking the mean and widening the variance are not the same operation — the second one changes how the stock interacts with everything else in the book.

Second, the selection trigger is under-examined. Most papers use one firing rule (news arrives, sentiment crosses a threshold, trade) and then spend their energy comparing sentiment models: FinBERT vs GPT-4 vs a lexicon. This paper’s claim is that the choice of trigger — and the choice of allocator — is at least as consequential as the choice of language model, which if true reallocates a lot of research effort.

The specific target is Russell 2000 equities, which is a deliberate choice: small caps are thinly covered by analysts, so news has more incremental information, but they’re also where transaction costs and microstructure noise eat returns fastest. That tension is the paper’s real testing ground.

   PROBLEM
   [ LLM signals feed only the mean vector;      ]
   [ risk stays historical; one trigger rule     ]
                    |
                    v
   ASSUMPTION
   [ Predicted uncertainty is decomposable      ]
   [ into aleatoric (noise) + epistemic (model  ]
   [ ignorance), and belongs in the COVARIANCE  ]
                    |
                    v
   METHOD
   [ LLM sentiment ] --> [ return + variance ]
                              |
                              v
                    [ inject into Sigma ]
                              |
        +---------------------+---------------------+
        |                     |                     |
   [ pure-alpha ]        [ pure-beta ]        [ beta = both ]
   firm-specific         macro leads          agree
        |                     |                     |
        +---------------------+---------------------+
                              v
                    [ allocator: risk parity /
                      min-var / mean-var ]
                              |
                              v
   EVIDENCE
   [ Russell 2000, holding grid 1..100d,        ]
   [ costs 0 -> 100 bps. Separated legs usually ]
   [ beat the intersection. Best conservative:  ]
   [ pure beta + GPT-4o mini + Student-t +      ]
   [ 40d + risk parity => Sharpe 2.33 @100bps   ]
                    |
                    v
   CONCLUSION
   [ Regime and allocator matter >= sentiment   ]
   [ model. Requiring both channels to fire     ]
   [ destroys information rather than filtering ]
   [ noise.                                     ]

The Increment

One sentence: Before, an LLM’s read on the news set *where you pointed the portfolio; after, it also sets how wide the cone of fire is around each name — and the paper shows that separating firm-specific from macro-driven triggers beats the intuitive “wait for confirmation from both” rule.

Core Mechanism

The pipeline has four stages, and the interesting engineering is in the seam between stages two and three.

Stage 1 — signal extraction. News items for Russell 2000 names go through an LLM (GPT-4o mini is the one named in the headline result) which emits a sentiment/return view. Alongside it, macroeconomic and sector indicators are tracked as a separate channel. So each stock, at each timestamp, has two independent reasons it might light up: something happened to *it, or something happened to a liquid macro/sector proxy it’s exposed to.

Stage 2 — uncertainty decomposition. Rather than a point forecast, the model produces a predictive distribution and splits its variance in two. Aleatoric variance is the irreducible part — this stock is just volatile, this news type is just ambiguous. Epistemic variance is the model’s own ignorance — few similar examples, unusual phrasing, thin news history. The paper also parameterizes the predictive target with a Student-t rather than a Gaussian, which is what wins in the best configuration; fat tails are not a cosmetic choice for small caps.

Stage 3 — injection into the covariance matrix. This is the load-bearing step. Instead of using the predicted variance to discount the expected return, the per-asset predicted variances are written into the diagonal (and, through the residual structure, the off-diagonals) of the covariance matrix Sigma that the allocator consumes. Consequence: a stock the model is unsure about doesn’t just get a smaller expected payoff, it gets treated as a *riskier object in the optimization — so it competes for risk budget differently, and its interaction with correlated positions changes too. Under risk parity in particular, higher predicted variance mechanically shrinks the weight without any hand-tuned penalty.

Stage 4 — selection regime and allocation. Three triggers are compared: pure alpha (the stock moves abnormally in a way macro indicators don’t explain), pure beta (the macro/sector channel fires *before the stock does, catching lead-lag spillover), and beta-intersection (both channels agree). Then holding periods are swept from about one day to a hundred, and transaction costs from zero up to 100 bps. The headline finding is that the two separated legs usually dominate the intersection on both Sharpe and raw return — the conjunction is too rare and too late.

  NEWS FLOW                       MACRO / SECTOR FLOW
      |                                   |
      v                                   v
  [ LLM (GPT-4o mini) ]            [ indicator moves ]
      |                                   |
      v                                   |
  [ predictive dist. ]                    |
   Student-t target                       |
      |                                   |
      +-------> mu_i (mean)               |
      |                                   |
      +-------> var_alea  (noise)         |
      +-------> var_epis  (ignorance)     |
                    |                     |
                    v                     |
        [ Sigma_hat = hist. cov           |
          + diag(var_alea + var_epis) ]   |
                    |                     |
                    |     TRIGGER LOGIC <-+
                    |          |
                    |   +------+-------+--------------+
                    |   |              |              |
                    |  pure-alpha   pure-beta    beta = AND
                    |  (stock only) (macro 1st) (both fire)
                    |   |              |              |
                    v   v              v              v
              [ ALLOCATOR: risk parity | min-var | mean-var ]
                              |
                              v
                 [ weights ] -> hold 1..100 days
                              |
                              v
               [ Sharpe / return @ 0..100 bps cost ]

Here’s the metaphor that carries it. Think of a self-driving car’s perception-to-planner stack.

The LLM is the camera. It looks at the road (the news) and says “the truck ahead is braking.” That’s mu — a directional call. But a decent perception system also reports two very different kinds of doubt. Fog is aleatoric: the sensor is doing its best, the world is genuinely murky, and no amount of better software fixes it tonight. An unmapped intersection is epistemic: the system has simply never seen this configuration, and more training data would fix it. Both make you less sure about the truck, for entirely different reasons.

Now, the naive stack does what most LLM-trading papers do: it feeds only the directional call to the planner and drives at a fixed, pre-set caution level derived from yesterday’s road conditions. This paper’s stack instead pipes both doubts into the risk map that the planner uses — the covariance matrix. Fog and unmapped roads don’t reduce the truck’s importance; they *inflate the bubble of space you keep around it, which then changes your whole trajectory, including how you treat the other cars near it. The allocator is the path planner: risk parity is the conservative planner that gives every obstacle an equal share of your attention budget, so inflated bubbles automatically get less throttle.

And the trigger regimes are the question of which alert you act on. Pure alpha is “this specific truck’s brake lights came on.” Pure beta is “the traffic radio said there’s a jam two miles up, and the trucks around me haven’t reacted yet” — that’s the lead-lag spillover, and at one-day horizons it works precisely because liquid macro proxies react before illiquid small caps do. Beta-intersection is “I’ll only brake if the radio *and the brake lights agree” — which sounds prudent and is actually the worst of the three, because by the time both agree you’re already in the jam. The Student-t target, in this picture, is admitting that the road occasionally has a deer on it: a Gaussian planner is calibrated for a world without deer.

Key Concepts

• Aleatoric vs epistemic uncertainty: Roll a fair die. You cannot predict the outcome, but you know exactly how unpredictable it is — that’s aleatoric, irreducible randomness baked into the process. Now hand someone a die from an unfamiliar game with symbols instead of pips. They don’t know the distribution *at all; that’s epistemic, ignorance that would vanish with more information. In this paper, an LLM reading a routine earnings release about a chronically volatile biotech has high aleatoric uncertainty (the stock swings, period). An LLM reading a bizarre regulatory filing with no precedent in its training distribution has high epistemic uncertainty (it doesn’t know what this means). The practical distinction matters because epistemic uncertainty is your problem — it shrinks with a better model or more data — while aleatoric uncertainty is the market’s, and you should just size down.

• Why the covariance matrix, not the mean: Suppose you have two stocks and you’re unsure about stock A. Option one: cut A’s expected return in half. Option two: double A’s estimated variance. In a single-asset bet these look similar. In a portfolio they’re completely different. Cutting the mean is a one-dimensional demotion. Doubling the variance changes A’s *relationship with everything else — it changes how much A can offset B, how much total risk the book is running, and under risk parity it directly shrinks A’s weight without you writing a rule. Uncertainty is fundamentally a second-moment statement, and putting it in the first moment loses the interaction structure.

• Pure beta as lead-lag arbitrage: Small caps are illiquid; index futures, sector ETFs, and macro series are liquid. When new macro information arrives, the liquid instruments reprice in minutes and the illiquid small cap reprices over hours or days. “Pure beta” means: fire the trade when the macro channel has moved *but the stock hasn’t yet. The paper reports this works at a one-day horizon under low-to-moderate costs and dies at 100 bps — exactly what you’d expect from a fast, high-turnover mechanism. What’s more interesting is that pure beta also works at 40 days, for a completely different reason: slow macro repricing grinds on for weeks and eventually outweighs the firm-specific news signal, which decays. Same label, two unrelated economic engines, and the paper deserves credit for saying so out loud instead of blending them into one story.

Framework Shift

  Before (mainstream approach):        After (this paper):

  [ news ]                            [ news ]      [ macro ]
     |                                   |              |
     v                                   v              |
  [ LLM sentiment ]                   [ LLM dist. ]     |
     |                                   |              |
     v                                mu | var_a+var_e  |
  [ mu vector ]                          |    |         |
     |                                   |    |    trigger
     |    Sigma from                     |    |    selector
     |    history (fixed)                |    |     / | \
     v      |                            |    |    a  b  a&b
  [ optimizer ] <---+                    |    v      \ | /
     |                                   |  [ Sigma ] \|/
     v                                   |    |        |
  [ weights ]                            +----+--------+
                                              v
   one trigger rule,                   [ allocator sweep ]
   compare sentiment models                   |
                                              v
                                       [ weights ]

                                       grid: 3 regimes
                                       x holding 1..100d
                                       x cost 0..100bps

*From “the LLM tells me what to buy” to “the LLM tells me what to buy and how little to trust itself, and the trigger that woke it up is a first-class design variable” — the core shift is moving model confidence from the first moment to the second, and promoting the selection rule from an implementation detail to a compared hyperparameter.

Expert Assessment

Problem choice: The gap is real, not manufactured. Uncertainty-aware portfolio construction has a long lineage (Black-Litterman confidence, robust optimization, Bayesian shrinkage), and the LLM-finance literature has been remarkably incurious about connecting to it — most papers are “new sentiment encoder, same mean-variance plumbing.” Insisting that predicted risk belongs in Sigma is the right correction, and the aleatoric/epistemic split is the natural way to get there since deep-learning uncertainty quantification already gives you both terms for free. The trigger-decomposition contribution is the fresher of the two: the finding that requiring *both channels to fire is worse than either alone is genuinely counterintuitive and has an economically legible explanation (conjunction is rare and arrives late). That’s the part I’d want to read closely.

Method maturity: Honestly, more assembly than invention. Every component — LLM sentiment extraction, aleatoric/epistemic decomposition, Student-t heads, risk parity, alpha/beta decomposition — is off the shelf. The contribution is the wiring and the systematic sweep, which is legitimate but modest. And there’s a simpler baseline lurking that I’d bet wasn’t given a fair shot: just widen the diagonal of Sigma proportionally to a *single predicted variance, no aleatoric/epistemic split at all. If the decomposition buys nothing over total predicted variance, the paper’s most theoretically interesting claim collapses into a plumbing change. The abstract’s own emphasis — “regime and allocator matter at least as much as the sentiment model” — quietly suggests the LLM-side sophistication isn’t where the returns come from.

Experimental integrity: This is where I’d push hardest. Three concerns.

The first is the grid. Three regimes × a full holding-period sweep × multiple allocators × multiple sentiment models × multiple distributional targets × four cost levels is easily hundreds of configurations, and the headline is “the strongest conservative row.” Reporting a maximum over a large grid is not evidence of an effect; it’s evidence of a grid. Sharpe 2.33 net of 100 bps in Russell 2000 names is a number I do not believe as a forward-looking estimate. The honest version of this result needs a deflated Sharpe ratio or a multiple-testing correction, and the abstract gives no sign one was applied.

The second is lookahead through the language model. GPT-4o mini’s training data covers the historical period being backtested. When it scores a 2019 headline, it may already know how the story ended. This is the central methodological hazard of the entire LLM-finance genre, and it’s not solvable by careful data alignment — the leak is inside the weights. Any paper claiming Sharpe above ~1.5 on historical news needs to address it head-on, ideally with a strictly post-training-cutoff out-of-sample period.

The third is capacity. Russell 2000 constituents plus 40-day holds plus a trigger-driven selection process implies a concentrated book in names where a modest allocation moves the price. A flat 100 bps cost assumption does not capture that; realistic slippage in the bottom decile of the index is worse and, more importantly, non-linear in size. Whether Sharpe 2.33 survives at 50 million dollars is a different question from whether it survives at 100 bps.

To be fair, several things in the design are reassuring: sweeping costs up to 100 bps rather than assuming frictionless trading is good discipline, and the fact that pure beta’s one-day edge disappears at high costs is exactly the kind of negative result an overfitting-driven paper wouldn’t bother to report. The mechanism story — two different economic engines for the same trigger at different horizons — also reads like something learned from the data rather than imposed on it.

Writing quality: The abstract does something I wish more papers did: it explains *why the same strategy works at 1 day and 40 days for different reasons, instead of papering over it. That’s real thinking. Where corners look cut is in the ablation discipline. The paper is framed as a contribution about uncertainty injection, but its own conclusion is about regimes and allocators — those are different papers, and the reader can’t tell which effect is doing the work without an ablation isolating (a) uncertainty in Sigma vs historical Sigma, holding everything else fixed, and (b) the aleatoric/epistemic split vs total variance. Rewriting the results section around a clean ablation ladder, with a deflated Sharpe on the headline number, would move this from “interesting sweep” to “citable finding.”

Verdict: borderline — the trigger-decomposition finding is genuinely interesting and the mechanism reasoning is thoughtful, but a headline Sharpe of 2.33 selected as the best row of a large grid, on LLM-scored historical news, isn’t yet evidence of anything I’d trade.

Takeaways

Things worth stealing, regardless of whether the returns are real:

1. Put predicted uncertainty in the second moment, not the first. This transfers well beyond finance. Any time a downstream optimizer consumes both a point estimate and a risk/cost structure, the standard move of shrinking the estimate discards interaction information. Widening the variance is a strictly richer intervention. Applies to robotics planners, bandit allocation, inventory optimization, anything with a quadratic objective.

2. Split your conjunctions before you trust them. “Trade when signal A and signal B agree” is one of the most reflexive designs in applied ML, and this paper’s central negative result is that the conjunction lost to both of its parts. The intuition: AND-gates trade recall for precision, and if your signals are lagged relative to each other, the AND-gate also trades *timeliness, which is often the whole edge. Always benchmark A alone, B alone, and A AND B — don’t assume the intersection is the “high-conviction” subset.

3. Same signal, different horizon, different mechanism. The paper’s treatment of pure beta working at 1 day (lead-lag spillover) and at 40 days (slow macro repricing) via unrelated channels is a good template for reading any horizon sweep. A U-shaped performance curve across holding periods usually means two mechanisms, not one — and they’ll have different failure modes and different cost sensitivities.

4. Sweep costs, not just parameters. The most informative result in the abstract is a *failure: pure beta at one day works until 100 bps and then doesn’t. Frictions as an explicit axis turns a performance table into a mechanism diagnostic — anything that dies under cost was turnover-driven, anything that survives was information-driven.

5. What not to take: the specific configuration (GPT-4o mini + Student-t + 40 days + risk parity) and its Sharpe. That’s the argmax of a large grid on a single universe, and treating it as a recipe is exactly the mistake the number invites.