Active Exploration Closes the Conjunctive Reasoning Gap Between Humans and LLMs

Paper: 2606.06464 Authors: Mandana Samiei, Eunice Yiu, Anthony GX-Chen, Dongyan Lin, Jocelyn Shen, Blake A. Richards, Alison Gopnik, Doina Precup Categories: cs.CL

The Gap

Cognitive science has long documented the “conjunctive handicap”: adults easily learn disjunctive causal rules (A OR B causes effect) but struggle with conjunctive rules (A AND B both needed). Prior work attributed this to inherent cognitive bias. However, nearly all evidence comes from passive observation paradigms where learners watch pre-selected evidence sequences without control.

The gap: Does this handicap persist when learners actively choose what evidence to generate? And do LLMs, trained on passive text corpora, exhibit similar exploration-dependent improvements?

Prior belief: Conjunctive handicap = cognitive bias
                    |
                    v
Question: What if it's evidence generation constraint?
                    |
                    v
Method: Give humans/LLMs agency (blicket detector + free intervention)
                    |
                    v
Evidence: Active exploration cuts conjunctive gap by ~60%
                    |
                    v
Conclusion: The handicap is partially strategic, not purely cognitive

The Increment

One sentence: Before this paper, the conjunctive handicap was treated as a fixed cognitive limitation; after, it’s reframed as partly an exploration efficiency problem that both humans and LLMs can overcome with agency.

Core Mechanism

The method uses a modified “blicket detector” task. Participants see colored blocks and a machine that activates when the correct block combination is placed on it. The causal structure is either conjunctive (both blue AND red blocks needed) or disjunctive (either blue OR red works). Unlike traditional passive paradigms where participants watch predetermined sequences, here they actively choose which blocks to test on each trial.

For humans, experimenters track intervention sequences and final hypothesis accuracy. For LLMs (GPT-4, Claude, Gemini variants), the authors implement the same task in text: the model receives block placement outcomes, generates natural language reasoning, proposes next tests, and ultimately states its causal hypothesis.

The key measurement: intervention efficiency (tests needed to reach correct hypothesis) and accuracy across rule types.

Participant --> Choose blocks --> Place on detector --> Observe outcome
     ^                                                         |
     |                                                         v
     +-------------- Update hypothesis <--------------------- Result
                            |
                            v
                    Repeat until confident
                            |
                            v
                    State final rule

Think of this like debugging a circuit with a multimeter. In passive mode, someone hands you a report of voltage readings at various points—you guess the fault from their choices. In active mode, you hold the probes yourself. You can test suspicious junctions first, narrow down systematically, and converge faster. The conjunctive handicap is like struggling to diagnose a fault requiring two broken components (AND logic) versus one of several possible breaks (OR logic). When you can choose probe points, you develop targeted strategies—test components individually, then in combination—that passive observation never reveals.

The metaphor’s weight-bearing: Blocks = circuit components. Detector activation = circuit function. Interventions = probe placements. Conjunctive rule = multi-component fault. Active exploration = strategic probing vs reading someone else’s measurements.

Key Concepts

• Conjunctive vs Disjunctive Causal Rules: Imagine a door that only opens when you insert both a key AND scan a fingerprint (conjunctive) versus a door that opens with either key OR fingerprint (disjunctive). Conjunctive rules have a sparse activation space—only one specific combination works, everything else fails. Disjunctive rules have a dense space—multiple paths succeed. When observing randomly, you rarely see the one working conjunctive combination, but frequently hit some disjunctive solution. Active exploration lets you isolate variables: test key alone, fingerprint alone, then both—a strategy unavailable in passive observation.

• Blicket Detector Paradigm: A toy machine used in developmental psychology. Place objects on it; it lights up or stays dark based on hidden causal rules. Originally designed for children (“blickets” are causal objects), it’s abstracted here to colored blocks and logical rules. The beauty: it isolates causal inference from real-world confounds like physics or prior knowledge. You’re learning pure logical structure from activation patterns.

• Intervention Efficiency: Not just “did you get it right?” but “how many tests did you need?” Two learners might both solve the puzzle, but one takes 15 trials, the other 6. Efficiency reveals strategy sophistication. Optimal conjunctive exploration: test each candidate individually (eliminate non-causes), then test combinations of remaining candidates. Optimal disjunctive: test each individually until one activates. The paper shows humans approach this ideal under active exploration; LLMs often don’t.

Framework Shift

Before (passive observation):        After (active exploration):

Evidence --> [Black box] --> Guess    Hypothesis --> Choose test --> Update
   |           cognitive                   ^              |             |
Fixed          bottleneck                  |              v             |
sequence                                   +-------- Observe ------+
   |                                                     |
   v                                                     v
Conjunctive                              Conjunctive ~ Disjunctive
handicap                                 (gap reduced 60%)
persists

From accepting evidence sequences as given to strategically generating diagnostic evidence, the core shift is control enabling hypothesis-driven exploration rather than passive pattern matching.

Expert Assessment

Problem choice: This is a real gap with theoretical depth. The field has documented the conjunctive handicap for decades but never systematically separated cognitive bias from evidence structure. Comparing humans and LLMs in identical active settings is clever—LLMs provide a controlled “second species” to test whether the pattern is universal or human-specific. Solid positioning in both cognitive science and AI evaluation.

Method maturity: The blicket detector is a well-validated paradigm; extending it to active intervention is straightforward. The LLM implementation is fair—models receive the same information format as humans and must generate both reasoning and actions. However, the paper doesn’t deeply analyze *why LLMs use suboptimal strategies (do they lack working memory for hypothesis tracking? Are they biased by training text patterns?). The method opens the question but doesn’t answer the mechanism.

Experimental integrity: Baselines are reasonable. The conjunctive-disjunctive contrast is within-subjects for humans, between-conditions for LLMs (due to context contamination concerns). Sample sizes are modest (N=60 humans, unclear LLM trial counts per model), but effect sizes are large enough to be convincing. One flag: no analysis of whether human improvement is learning-to-explore (skill acquisition across trials) or immediate strategic adaptation. This matters for interpretation.

Writing quality: The introduction clearly motivates the gap. Methods are precise. Results section is crisp. The discussion, however, oversells the LLM-human comparison—models approach human accuracy but with fundamentally different exploration profiles, yet the paper treats this as “similar performance.” A rewritten discussion distinguishing outcome similarity from process similarity would sharpen the contribution. Also, the related work section undersells prior work on active learning in causal inference outside the blicket paradigm.

Verdict: Weak accept — Solid empirical contribution showing active exploration mitigates a long-standing cognitive bias, with interesting LLM comparison, but lacks mechanistic depth on why the improvement occurs or why LLMs differ in exploration strategy.

Takeaways

For AI practitioners: If your model struggles with conjunctive reasoning (e.g., multi-condition policy rules, composite fault diagnosis), consider whether it’s trained only on passive observation corpora. Adding active exploration trajectories—logs where agents choose informative tests—to training data might improve systematic reasoning. The paper’s result suggests the bottleneck isn’t representational capacity but exploration strategy.

For experiment designers: When evaluating causal reasoning, control for evidence selection bias. A model that performs well on curated examples might fail when forced to generate its own evidence sequence. The blicket detector’s simplicity makes it a good unit test for this.

For cognitive scientists: The finding that active exploration reduces the conjunctive handicap suggests the bias is partly an artifact of passive paradigms. Future work should check whether other “cognitive limitations” similarly dissolve under strategic control.