HAMON: Passive Optical Sequence Mixing for Long-Horizon Forecasting

Paper: 2606.17028 Authors: Alper Yıldırım Categories: cs.LG, cs.AI, cs.AR

The Gap

Recent work in long-horizon forecasting has shown that simple linear models (e.g., DLinear, FEDformer’s frequency components) often match or beat transformer-based architectures, despite transformers dominating NLP and vision. Mechanistic studies even suggest that the necessary forecasting operator is low-complexity and approximately linear — so why are we still burning compute on dense, learned digital attention? Prior approaches all sit in the digital domain: they train neural networks with millions of parameters to learn temporal mixing layers (self-attention, convolutions, MLPs). This creates a mismatch: if the core operator is simple, why implement it with a heavy learned digital model?

This paper asks the substrate-level question: can the forecasting itself be performed by a passive physical process — specifically, by diffractive optics — with no learned digital sequence mixing at inference? The logical path is straightforward:

 Problem: digital temporal mixing is heavy for a simple operator
    |
    v
 Assumption: the forecasting operator is low-complexity and ~linear
    |
    v
 Method: replace digital mixing with passive optical diffraction
    |
    v
 Evidence: on ETTm2 and ETTh2, optical core beats digital baselines
    |
    v
 Conclusion: a passive optical core can serve as a forecasting engine

The Increment

One sentence: Before this paper, forecasting meant training a digital neural network with a temporal mixing layer; after this paper, forecasting can be done by a single passive optical propagation pass through trainable phase masks — no digital mixing at inference.

Core Mechanism

HAMON encodes the input historical sequence onto an optical aperture. The key trick: future time steps are left dark (no amplitude or phase encoded for them). Then the light passes through a cascade of trainable phase masks with free-space diffraction between them — standard Fourier optics. The output field at the aperture’s image plane directly contains the forecast: the intensity distribution across spatial positions corresponds to predicted values at future time steps. At inference, you literally shine light through the device and measure the pattern. No digital mixing layer, no neural network forward pass — just physics.

The components: (1) Input encoder: maps each historical value to a phase shift at a specific aperture location (phase modulation preserves light intensity for readout). (2) Trainable phase masks: typically 2–4 layers of phase pixels that are optimized via a differentiable simulator (TorchOptics). (3) Diffraction propagation: modeled by the angular spectrum method. (4) Output detector: captures the intensity field at the forecast positions.

      Input sequence (historical)
         |
    +---------+
    | Encoder |  (phase modulation per time step)
    +---------+
         |  light
    +---------+     +---------+     +---------+
    | Phase   | --> | Free    | --> | Phase   | ...
    | Mask 1  |     | Space   |     | Mask 2  |
    +---------+     +---------+     +---------+
         |                      (cascaded diffraction)
         v
    +---------+
    | Output  |  (intensity = forecast values)
    +---------+

Structural metaphor: Think of HAMON as an old-fashioned slide projector. The historical sequence is a photographic slide where each time step is a tiny region that either blocks or transmits light. But here, instead of just blocking, we twist the phase of the light (like using a piece of etched glass). The trainable phase masks are like a set of lenses and patterned filters that you slide in between the light source and the screen. Each mask bends the light in a specific way. When you put the slide (encoded history) in the projector and turn on the light, the beam passes through the lens stack and projects the forecast image onto the screen. The crucial difference: the lenses (phase masks) are not designed by a human engineer but learned through simulation. And the screen isn’t showing a picture of the past — it shows the future values. You never compute anything electronically during projection; the light does all the work.

Key Concepts

• Passive optical computation: Computation that uses only the propagation of light through static or quasi-static optical elements. No electro-optical modulation at inference time; the light itself performs the mathematical operation (here, a learned transformation from input sequence to output forecast). The advantage: near-zero energy consumption per inference (only the light source and detector need power), and potentially high throughput because light propagates at the speed of light.

• Diffractive neural network (D2NN): A class of optical neural networks where layers are thin, trainable phase masks and the inter-layer “activation” is free-space diffraction. Each mask modulates the phase of the wavefront, and diffraction implements a linear transformation (convolution with a free-space kernel). The entire system is differentiable through a physical simulator, allowing end-to-end training with backpropagation. HAMON applies this idea to time-series forecasting: the input is a one-dimensional sequence, not an image.

• Forecasting as a spatial mapping: HAMON reinterprets time-series prediction as a spatial transformation: historical values are placed at spatial positions (aperture), and the forecast values appear at other spatial positions (output plane). This is unlike digital models that process time as a temporal dimension. It’s a neat trick because optics naturally operates in space; by encoding time as space, the diffraction can “mix” the sequence without temporal recurrence.

Framework Shift

Here’s the structural difference between mainstream digital forecasting and HAMON:

Before (mainstream approach):        After (this paper):
+--------------------------------+   +--------------------------------+
| Input: historical values       |   | Input: historical values        |
| (time series)                  |   | encoded as phase on aperture   |
|         |                      |   |         |                       |
|    +---------+                 |   |    +---------+                  |
|    | Digital |   learned       |   |    | Phase   |  trainable      |
|    | Temporal|   mixing        |   |    | Masks   |  but passive    |
|    | Mixing  |   (e.g. attn)   |   |    | + Free  |  during         |
|    | Layer   |   requires      |   |    | Space   |  inference      |
|    +---------+   energy        |   |    +---------+                  |
|         |        per inference |   |         |   no digital mixing  |
|    +---------+                 |   |    +---------+                  |
|    | Output  |   digital       |   |    | Output  |  intensity only |
|    | Layer   |   neurons       |   |    | Field   |  (photons)      |
|    +---------+                 |   |    +---------+                  |
+--------------------------------+   +--------------------------------+

One sentence: From learned digital temporal mixing (heavy compute per inference) to passive optical spatial mixing (light does the work), the core shift is offloading the forecasting operator to physical optics, eliminating the need for any digital sequence-mixing layer at runtime.

Expert Assessment

Problem choice: Real gap. The observation that simple models often win on forecasting benchmarks is well-documented, yet the community continues to propose ever larger digital models. Questioning the substrate is smart — it points to a mismatch between the computational tool and the problem’s complexity. However, the gap is more about engineering practicality than scientific depth; the paper’s true novelty is in asking “why not optics?” rather than in the optical technique itself (diffractive networks exist).

Method maturity: Clever insight but not fully baked. The optical core is trained via simulator and then (presumably) would be fabricated as a static optical element. The paper doesn’t address fabrication tolerances, misalignment, or material dispersion — all real issues for deployment. The ablations (phase scrambling, intensity readout) are well done, showing that the optical field carries the information, not a digital post-processing head. But the cross-simulator check is weak: only one alternative simulator (TorchOptics) and no experimental validation. A simpler approach might be using a digital linear model with a fixed kernel, which would achieve similar performance with much less hassle.

Experimental integrity: Reasonable. Baselines are standard: DLinear, FEDformer, Informer, etc. The results show HAMON beating the strongest baselines on ETTm2 (all horizons) and ETTh2 (all but longest). That’s a strong claim. The author includes MSE improvement percentages (up to 14%) and shows consistent outperformance across horizons, not cherry-picked points. However, on Weather the model is only competitive, and on Traffic/Electricity (high channel count) it trails significantly. This suggests the optical approach struggles with multivariate series — a limitation not deeply discussed. Also, the hyperparameter search for the optical system (number of masks, pixel size) seems limited; there may be better optical designs.

Writing quality: Clear and to the point. The abstract and introduction are well-motivated. The method section is concise given the complexity. Where the authors cut corners is in the “Discussion” section: they barely address practical limitations (noise, coherence, CMOS readout, scaling to high channels). Rewriting that section with honest trade-offs would greatly strengthen the paper’s credibility.

Verdict: Weak accept — provocative idea that reframes the forecasting problem, but flinches on implementation reality and leaves big practical questions open.

Takeaways

1. The “substrate question”: When a task has inherently low complexity, ask whether your computational substrate (digital, analog, optical) is overkill. Hammering nails with a microscope might be elegant, but a rock works too. This paper gives a concrete example of matching substrate to operator simplicity.

2. Space-time duality for time series: Encoding time steps as spatial positions and using spatial propagation (diffraction) to mix them is a transferable trick. Any researcher dealing with sequential data that has a short history could consider a fixed spatial transform (e.g., a convolution with a learned kernel) rather than a full recurrent or attention mechanism. The optics angle is exotic, but the core idea — replace temporal mixing with spatial mixing — applies to digital architectures too (e.g., treating time as a spatial dimension for CNNs).

3. Passive inference as a design goal: Even if you never build the optics, the mindset of eliminating active compute during inference is valuable. Could you precompute a transformation that is applied as a fixed matrix multiply (like a linear time-invariant filter) instead of a neural network forward pass? HAMON shows that for forecasting, the performance might be good enough.