Causal Discovery Meets Irregular Time Series: Extending PCMCI+ Beyond Fixed Lags

Paper: 2607.18226 Authors: Martim Penim, Ricardo Ribeiro Pereira, Jacopo Bono, Hugo Ferreira, Mário A. T. Figueiredo, Pedro Bizarro Categories: cs.LG, stat.ME

The Gap

Causal discovery on time series has matured considerably. Methods like PCMCI+ (from the Tigramite library) can recover causal graphs from multivariate temporal data with impressive accuracy. But here’s the catch: they all assume your data arrives like clockwork — evenly spaced, no missing ticks, regular as a metronome.

The real world doesn’t cooperate. Sensor networks drop packets. Patients get vitals taken at irregular intervals. Financial transactions happen whenever they happen. When you feed irregularly sampled data to PCMCI+, it either forces you to bin and impute (losing information, introducing artifacts) or just breaks — the fixed-lag conditioning assumptions no longer hold.

This paper asks a clean question: can we keep the statistical rigor of PCMCI+ while ditching the regularity assumption?

+------------------+     +-------------------+     +------------------+
| Real-world data  |     | Existing methods  |     | What breaks      |
| is irregular     | --> | assume regularity | --> | or requires lossy|
| (sensors, health,|     | (PCMCI+, Granger, |     | binning/imputation|
| finance)         |     | VAR, etc.)        |     | to use them      |
+------------------+     +-------------------+     +------------------+
                                                            |
                                                            v
+------------------+     +-------------------+     +------------------+
| Causal graphs    | <-- | Window-based      | <-- | Replace fixed    |
| recovered on     |     | causal influence  |     | lags with        |
| irregular streams|     | aggregation       |     | temporal windows |
+------------------+     +-------------------+     +------------------+

The Increment

One sentence: Before this paper, applying PCMCI+ to irregular time series required lossy preprocessing; after this paper, there’s a principled extension that directly handles irregular sampling by aggregating causal influence over temporal windows instead of fixed lags.

Core Mechanism

The standard PCMCI+ framework discovers causal relationships by testing conditional independencies at specific discrete lags. It asks: “Does X at time t-3 help predict Y at time t, given everything else I’ve conditioned on?” The problem is that “t-3” assumes all observations are exactly 3 ticks apart. In irregular data, there is no universal “lag 3.”

The proposed method replaces discrete lags with temporal windows. Instead of testing whether X influences Y at exactly lag {k}, it tests whether X’s occurrences within a window [t-\Delta, t] have a statistically detectable influence on Y at time t. The method builds on the same PC-stable skeleton discovery and orientation rules of PCMCI+, but the conditional independence tests operate over these window-aggregated variables rather than point-wise lagged variables.

Concretely: for each pair of event streams, the method constructs features by counting or weighting events of one stream within predefined temporal windows relative to another stream’s events. These aggregated features then feed into the same conditional independence testing machinery (partial correlation tests via GPDC or similar) that PCMCI+ already uses. The orientation phase (determining causal direction) also adapts: instead of orienting edges based on lag ordering, it uses temporal ordering within windows.

Input: Irregular event streams S1, S2, ..., Sn
  |
  v
+------------------------------------------+
| For each pair (Si, Sj):                  |
|   Define temporal windows W1, W2, ...    |
|   Aggregate Si events within each Wk     |
|   relative to Sj event times             |
+------------------------------------------+
  |
  v
+------------------------------------------+
| Construct feature matrix:                |
|   X_agg(t) = aggregate(Si, Wk, t)       |
|   for all (i, k) pairs                   |
+------------------------------------------+
  |
  v
+------------------------------------------+
| Run PCMCI+ skeleton discovery:           |
|   Conditional independence tests         |
|   on window-aggregated variables         |
|   (partial correlation / GPDC)           |
+------------------------------------------+
  |
  v
+------------------------------------------+
| Orient edges using temporal window       |
| ordering instead of discrete lag order   |
+------------------------------------------+
  |
  v
Output: Causal graph G over event streams

Think of it like a fire investigator piecing together what caused a building fire. The old approach (standard PCMCI+) is like assuming every witness checks their watch perfectly and reports times in exact 5-minute intervals. You’d ask: “Did you see smoke exactly 15 minutes before the flames?” If their timing is off by a minute, your whole reconstruction breaks.

The new approach is like asking witnesses: “In the half hour before you saw flames, did you notice smoke? How about in the hour before that?” You’re not pinning events to exact timestamps — you’re surveying what happened within meaningful time windows. A fire investigator using windows doesn’t care whether the smoke appeared at t-17 minutes or t-22 minutes; they care whether smoke appeared in the relevant window before flames. That’s exactly what this method does for causal discovery: it surveys activity windows rather than demanding exact-timepoint alignment, making it robust to the messiness of real-world timing.

Key Concepts

• PCMCI+: Imagine you have 10 weather stations reporting temperature, and you want to figure out which stations causally influence which others over time. PCMCI+ is a two-phase algorithm: first it prunes away spurious connections (the “PC” part — named after Peter and Clark’s original algorithm), then it identifies the time-lagged causal direction (the “MCI” part — momentary conditional independence). It’s the gold standard for regular time series because it handles high-dimensional data well and controls false discovery rates. The ”+ ” refers to an improvement that also identifies contemporaneous (same-time) causal links.

• Temporal Window Aggregation: Instead of asking “what was the value at time t-3?”, this method asks “what happened between t-10 and t?” and summarizes that window into a single feature. It’s like the difference between checking your bank balance at exactly midnight on the 15th of each month, versus looking at your total spending over the past 2 weeks. The window approach is forgiving of irregular timing because it doesn’t demand events land on exact tick marks.

• Irregular Time Series: A regular time series is a heartbeat monitor — beep, beep, beep, perfectly spaced. An irregular time series is your text message history — 3 messages at 2pm, nothing until 8pm, then 15 messages in 5 minutes. Most real data (healthcare records, sensor failures, user clicks, financial trades) is irregular. The irregularity isn’t noise to be cleaned — it’s information about the generating process.

Framework Shift

Before (mainstream approach):        After (this paper):
                                     
Event stream A                       Event stream A
  |  |  |   |  |     |  |           *  *  *   *  *     *  *
  v  v  v   v  v     v  v           v  v  v   v  v     v  v
+--+--+--+--+--+--+--+--+--+      +-----------+---+--------+
|  t  t1  t2  t3 ...             |  window 1  |w2 | win 3  |
+--+--+--+--+--+--+--+--+--+      +-----------+---+--------+
  |  |  |   |  |     |  |              |          |       |
  v  v  v   v  v     v  v              v          v       v
Test fixed lags: Y(t) vs X(t-k)    Aggregate: mean/count
  for k = 1, 2, 3...               of X events in window
       |                                 |
       v                                 v
  [Regular grid assumed]           [No grid needed]

From fixed-lag point-wise conditioning to window-based temporal aggregation, the core shift is treating causal influence as something that accumulates over intervals rather than arriving at discrete ticks.

Expert Assessment

Problem choice: This is a genuine and practically important gap. Irregular time series are everywhere, and the workaround of binning/imputing before applying standard causal discovery is both lossy and statistically questionable. The paper doesn’t manufacture a problem — it identifies a real limitation in the dominant toolkit. That said, the field of continuous-time causal discovery (e.g., Hawkes process-based approaches) has been working on related problems, and this paper doesn’t deeply engage with that literature.

Method maturity: The core idea — replace fixed lags with temporal windows — is elegant in its simplicity. It’s more of a clever adaptation than a fundamentally new algorithm, which is both a strength (easy to implement, builds on proven machinery) and a limitation (the window size becomes a new hyperparameter that requires domain knowledge or tuning). There’s a risk of circularity: choosing the wrong window size could either merge distinct causal delays or split a single causal mechanism into fragments. The paper acknowledges this but doesn’t offer a fully principled window selection method.

Experimental integrity: The evaluation is synthetic-only, which is a notable limitation. They generate irregular event streams with known ground-truth causal structures and test recovery under varying signal-to-noise ratios. The baselines are fair — they compare against standard PCMCI+ applied with and without imputation. Results are consistent and the improvement is substantial on irregular data. However: no real-world dataset is tested, and the synthetic generators may not capture the full diversity of irregularity patterns seen in practice (bursty, periodic-irregular, etc.).

Writing quality: The paper is clearly written for its scope. The method description is transparent and reproducible. The weakest section is the related work — it doesn’t adequately position against continuous-time causal discovery methods or event-based approaches using point processes. A deeper literature engagement would significantly elevate the contribution’s framing.

Verdict: weak accept — The gap is real, the solution is clean and practical, but the limited experimental scope (synthetic only) and shallow related work prevent a strong endorsement. This is a solid incremental contribution that deserves dissemination but needs real-world validation to become truly convincing.

Takeaways

Three concrete things to steal:

1. The window aggregation trick: If you’re doing any kind of temporal analysis on irregular data (not just causal discovery), the idea of replacing discrete lags with temporal window features is immediately transferable. Granger causality, transfer entropy, cross-correlation — all of these can be “irregularized” the same way.

2. Don’t force regularity: The paper makes a compelling case that binning irregular data into regular grids throws away information. If your data is irregular, work with the irregularity rather than preprocessing it away. This mindset shift is worth more than any specific algorithm.

3. PCMCI+ is modular: The fact that you can swap out the lag structure while keeping the skeleton discovery and orientation logic intact reveals that PCMCI+ is more modular than most people treat it. This opens the door to other adaptations — different distance metrics, different aggregation schemes, domain-specific window definitions.