Neural Assemblies Learn Causal Direction Without Backpropagation

Paper: 2604.26919 Authors: Evangelia Kopadi, Dimitris Kalles Categories: cs.LG, cs.AI, cs.NE

The Gap

Neural assemblies — groups of neurons that fire together and wire together — have proven computationally powerful for classification, parsing, and planning. But there’s a missing piece: they haven’t been shown to learn which way causation flows. Existing causal discovery methods rely on backpropagation or statistical independence tests, neither of which map cleanly to biologically plausible neural dynamics. The result is a disconnect: we have formal causal models (Pearl’s do-calculus, structural equation models) and we have neural substrates (assemblies, Hebbian plasticity), but no demonstrated bridge showing that local synaptic rules can internalize directed causal relations.

This paper asks: can the basic operations of neural assemblies — projection, winner-take-all selection, and local plasticity — be sufficient to learn “A causes B” versus “B causes A”?

Problem: Neural assemblies lack directional learning
   |
   v
Assumption: Local plasticity + adaptive gain can encode direction
   |
   v
Method: DIRECT (co-activate source/target under gain schedule)
   |
   v
Evidence: Synaptic asymmetry + functional propagation tests
   |
   v
Conclusion: Perfect structural recovery in supervised setting

The Increment

One sentence: Before this paper, neural assemblies could represent correlations but not causal arrows; after, they can internalize “X→Y” as an auditable synaptic asymmetry using only local rules.

Core Mechanism

DIRECT (DIRectional Edge Coupling/Training) works by repeatedly co-activating two assemblies — one representing the cause, one the effect — while modulating the learning rate based on direction. When you want to teach “A causes B”, you fire assembly A, let it project to B, then strengthen those forward connections more than the reverse ones. The key trick is an adaptive gain schedule: early in training, the forward direction gets a learning boost; later, this boost decays, allowing the network to settle into a stable asymmetry.

The architecture has three layers: input assemblies (one per variable), a hidden layer where causal structure is encoded as weighted projections, and output assemblies for readout. During training, for each causal edge A→B, you activate A’s assembly, let winners emerge in the hidden layer via k-winners-take-all, then activate B’s assembly and apply Hebbian updates. The learning rate for forward connections (A’s winners to B’s assembly) is scaled by a gain factor that starts high and decays; reverse connections get a lower, constant rate.

Input Layer          Hidden Layer         Output Layer
                                          
[A assembly] -----> [winners] ---------> [A readout]
    |                  * *                    ^
    |                 *   *                   |
    | forward        *     *         reverse  |
    | (high gain)   *       *        (low gain)
    v              *         *                |
[B assembly] <----  * * * * * -------------> [B readout]
                    
Flow: A fires -> hidden winners -> B fires -> update weights
      (forward links get gain boost, reverse links don't)

Think of it like training a dog to associate a bell with food. You ring the bell (activate A), the dog’s neurons fire (hidden winners), then you present food (activate B). The dog’s brain strengthens “bell → food” more than “food → bell” because the bell consistently precedes the food. DIRECT does the same thing but with an explicit gain knob: the forward path gets a learning rate multiplier that says “this direction matters more right now.” Over many trials, the forward synapses grow stronger than the reverse ones, creating a physical asymmetry that encodes the causal arrow. The gain schedule is like gradually reducing the training treats — early on, you reinforce heavily; later, you let the learned pattern stabilize.

Key Concepts

• Neural Assembly: A group of neurons that represent a concept or variable by firing together. When you think “cat,” it’s not one neuron but a coalition of maybe 50-100 neurons that activate as a unit. Assemblies form through Hebbian learning: neurons that fire together wire together. In this paper, each variable (A, B, C) gets its own assembly. The assembly is the atomic unit of representation — you don’t care which specific neurons fire, only that *some stable group fires consistently for that variable.

• Synaptic Asymmetry: The weight difference between forward and reverse connections. If A→B is the true causal direction, then after training, the synaptic weights from A’s assembly to B’s assembly should be stronger than the weights from B’s to A’s. This asymmetry is the physical signature of directionality. It’s measurable: you literally subtract the average reverse weight from the average forward weight. A large positive gap means the network “believes” A causes B. This is what makes the causal claim auditable — you can point to specific synapses and say “these weights encode the arrow.”

• k-Winners-Take-All (kWTA): A sparse activation rule where only the top k most excited neurons fire, the rest stay silent. Imagine a classroom where the teacher asks a question and only the 5 students with the highest confidence raise their hands. kWTA enforces sparsity, which is biologically realistic (most neurons are quiet most of the time) and computationally useful (it prevents runaway activation and forces the network to commit to specific representations). In DIRECT, kWTA selects which hidden neurons participate in encoding each causal edge, making the learned structure interpretable.

Framework Shift

Before (backprop-based causal learning):    After (DIRECT):

Input -> [Black Box] -> Causal Graph        Input -> [Assembly A] 
         (gradient descent,                          |  |  |
          non-local updates,                         v  v  v
          opaque internals)                     [Hidden Winners]
                                                     |  |  |
                                                     v  v  v
                                                [Assembly B]
                                                
                                               Causal claim = 
                                               synaptic weight gap
                                               (auditable, local)

One sentence: From opaque gradient-based optimization to transparent synaptic asymmetries, the core shift is making causal directionality a first-class physical property of the network rather than an emergent byproduct of training.

Expert Assessment

Problem choice: Real gap. Neural assemblies are an established computational primitive with biological grounding, but their inability to handle directed relations was a known limitation. This isn’t manufactured — it’s a natural next question once you accept assemblies as a substrate for structured reasoning.

Method maturity: Clever but narrow. The gain schedule is a simple, effective trick, but it requires supervised knowledge of the causal structure (you need to know which edges to train). The paper acknowledges this — it’s a “known-structure” setting. For causal discovery (learning structure from data), you’d need an outer loop to search over possible graphs, which isn’t addressed. The dual-readout validation (synaptic asymmetry + functional propagation) is solid and gives confidence the method works as claimed.

Experimental integrity: Fair but limited. The experiments show perfect structural recovery on small graphs (3-5 variables), which is encouraging but not surprising given the supervised setup. Baselines are appropriate (random initialization, symmetric training). The missing piece is scalability — how does this perform on 20-variable graphs? 100? The paper doesn’t push the boundaries here, which is fine for a proof-of-concept but leaves open questions about practical applicability.

Writing quality: Clear in the method section, rushed in the discussion. The DIRECT mechanism is well-explained with good diagrams. The related work section could be tighter — it spends too much time on general neural assembly background and not enough contrasting with other biologically plausible causal learning approaches (e.g., predictive coding, free energy frameworks). The conclusion oversells the “explainable by design” angle without addressing the elephant in the room: this only works if you already know the causal structure.

Verdict: weak accept — Solid proof-of-concept for a well-motivated problem, but needs scaling experiments and a path to structure discovery before it’s a complete framework.

Takeaways

Adaptive gain schedules for directional learning: The core trick — modulating learning rates based on causal direction — is domain-agnostic. If you’re training any system where you want to encode asymmetric relations (not just causality: hierarchies, temporal sequences, dependency graphs), you can borrow this pattern. Start with a high gain for the “forward” direction, decay it over time, keep the reverse direction at a low constant rate. The resulting weight asymmetry becomes a readable signature of the relation.

Dual validation for learned structure: Don’t rely on a single metric. The paper uses both synaptic-level evidence (weight gaps) and functional evidence (propagation overlap). This is good practice for any learned representation: check that the internal structure (weights, activations) aligns with the external behavior (predictions, propagations). If they diverge, you’ve learned something brittle.

Sparsity as interpretability: kWTA isn’t just for biological realism — it makes the learned structure human-inspectable. When only a few neurons fire per assembly, you can trace which specific units encode which causal edges. This is a general principle: sparse representations are easier to audit than dense ones.