HERO'S JOURNEY: Testing Rule Induction Through Text-Based Goal Execution

Paper: 2606.02556 Authors: Anshun Asher Zheng, Kanishka Misra, David I. Beaver, Junyi Jessy Li Categories: cs.CL

The Gap

LLMs have shown impressive performance on single-shot reasoning tasks, but we don’t know if they can induce hidden rules from demonstrations and then execute multi-step plans based on those rules. Prior work evaluates either rule induction (pattern recognition from examples) or planning (multi-step execution) in isolation. This paper tests both together in a controlled setting: can models watch a few examples, figure out the underlying rule, and then act on that rule through a sequence of actions?

Problem: Rule induction + execution untested as integrated capability
   |
   v
Assumption: Text games provide controllable test environment
   |                    with observable action sequences
   v
Method: HERO'S JOURNEY benchmark
   |      - 8 tasks (attribute vs procedural)
   |      - 4 rule structures per task
   |      - Controllable lexical grounding
   v
Evidence: Models succeed on attribute tasks (70-80%)
   |       but struggle on procedural tasks (30-50%)
   |       Execution bottleneck > surface semantics
   v
Conclusion: LLMs can induce simple rules but lack
            robust procedural reasoning capacity

The Increment

One sentence: Before this paper, we knew LLMs could recognize patterns or plan actions separately; after, we know they fail at the junction where pattern recognition must guide sequential execution.

Core Mechanism

HERO’S JOURNEY constructs tasks in text-based game environments where an agent observes 3-5 demonstration episodes, then must complete a new episode by inferring and applying the hidden rule. Each task has four structural variants: conjunctive rules (e.g., “collect items with property A AND property B”), disjunctive rules (“property A OR property B”), negation rules (“NOT property A”), and exception rules (“property A EXCEPT when condition C”).

The benchmark separates tasks into two families. Attribute tasks require identifying object properties (e.g., “collect red items” or “collect items that are not fragile”). Procedural tasks require inferring action sequences (e.g., “always unlock before opening” or “use item X then item Y”). Each task also controls lexical grounding: some use concrete words (“red,” “unlock”), others use abstract placeholders (“property-7,” “action-B”) to test whether models rely on world knowledge shortcuts.

Demonstration Phase          Test Phase
==================          ===========
Episode 1: [observations]   New episode starts
  Agent actions: A, B, C       |
  Outcome: Success             v
                           Model must:
Episode 2: [observations]   1. Induce hidden rule
  Agent actions: D, E, F       |
  Outcome: Success             v
                           2. Generate action sequence
Episode 3: [observations]      |
  Agent actions: G, H          v
  Outcome: Success          3. Execute until goal reached
                               or failure
         |
         v
    [Hidden Rule]
    (never shown)

Think of HERO’S JOURNEY as a cooking class where you watch three chefs make different dishes, but the instructor never tells you the core technique they’re all using. You have to notice the pattern (always sear meat before braising, always bloom spices in oil first) and then cook your own dish using that technique. The attribute tasks are like noticing ingredient patterns (“they all use acidic elements”), while procedural tasks are like noticing technique sequences (“they always do X before Y”). The lexical grounding control is like testing whether you can still recognize the technique when ingredients have unfamiliar names written in a foreign script.

Key Concepts

• Rule Induction: The process of inferring a general principle from specific examples. Not memorization (storing exact patterns) and not interpolation (blending between seen cases), but extracting the abstract rule that generated the examples. For instance, if you see someone unlock three different doors before opening them, rule induction means concluding “doors must be unlocked before opening” rather than memorizing those three specific door-opening sequences. The induced rule must generalize to new doors you’ve never seen.

• Identifiability: Whether a rule can be uniquely determined from the given demonstrations, or whether multiple rules could explain the same observations. If someone always picks red apples from a basket containing red and green apples, the rule could be “pick red items” or “pick apples” (if only apples are red). The demonstrations don’t distinguish between these hypotheses. HERO’S JOURNEY ensures identifiability by design: the demonstrations always contain enough information to pinpoint exactly one rule from the four structural variants.

• Execution Bottleneck: The performance gap introduced by having to act out a plan, not just state it. A model might correctly identify the rule (“collect fragile items”) but fail during execution because it makes action errors (trying to pick up an item already in inventory, moving to the wrong location). This separates “knowing what to do” from “successfully doing it,” revealing whether the limiting factor is reasoning or operational control.

Framework Shift

Before (mainstream approach):        After (this paper):

Rule Induction Alone:                Integrated Test:
                                     
[Examples] --> [Rule]                [Examples] --> [Rule]
                                            |
Test: State the rule                       v
                                     [Action Sequence]
                                            |
Planning Alone:                            v
                                     [Goal Achievement]
[Goal + Rules] --> [Plan]            
                                     Test: Execute using
Test: Generate plan                  induced rule

From evaluating capabilities in isolation to testing the handoff between induction and execution, the core shift is measuring whether understanding translates to operational competence.

Expert Assessment

Problem choice: This is a real gap. The field has strong benchmarks for reasoning (GSM8K, Big-Bench) and planning (ALFWorld, WebShop), but few test whether models can bootstrap from observations to goal-directed behavior without explicit rule statements. The text game framing is clever—it provides natural grounding for multi-step tasks while maintaining experimental control.

Method maturity: Solid engineering with meaningful design choices. The four rule structures create difficulty gradients, and the lexical grounding control directly tests reliance on world knowledge. However, the demonstration phase is limited to 3-5 episodes. Would models improve with more examples? The paper doesn’t explore this, which feels like a missed opportunity to characterize sample efficiency.

Experimental integrity: Baselines are reasonable (GPT-4, Claude, Llama models), and the evaluation distinguishes rule induction accuracy from execution success, which is essential. The finding that “process execution adds an execution bottleneck” is backed by ablation studies. But the paper lacks error analysis—what types of procedural rules are hardest, and why? Are models failing at temporal reasoning, causal chaining, or state tracking?

Writing quality: The introduction is crisp, but the results section drowns in tables. Figure 3 (showing task performance) should be the centerpiece, but it’s buried. The discussion of “induction-specific steering methods” (prompt engineering techniques) feels tacked on—it works for attribute tasks but not procedural tasks, and the paper doesn’t explain why. Rewriting Section 5 to focus on error patterns instead of method variations would make this paper much stronger.

Verdict: weak accept — Identifies an important capability gap and provides a clean testbed, but the analysis doesn’t go deep enough to explain why procedural induction fails or how to fix it.

Takeaways

Practitioners working on agentic systems should steal the two-phase evaluation structure: test rule induction separately from execution, then measure both together. This reveals whether your system’s bottleneck is understanding or acting. The lexical grounding control is also worth adopting—testing with abstract tokens (“action-7” instead of “unlock”) exposes whether your model relies on linguistic shortcuts rather than genuine reasoning.

For researchers, the key insight is that attribute-based rules (properties of objects) are learnable by current LLMs, but procedural rules (sequences of actions with temporal or causal structure) remain a frontier. If you’re building reasoning systems, focus on temporal and causal representation—that’s where the capability ceiling is.