Fail2Drive: Why Self-Driving Models Memorize Routes Instead of Learning to Drive

Paper: 2604.08535 Authors: Simon Gerstenecker, Andreas Geiger, Katrin Renz Categories: cs.RO, cs.CV

The Gap

Existing closed-loop driving benchmarks in CARLA test models on the same scenarios used during training. This creates a fundamental measurement problem: when a model succeeds, we can’t tell if it learned to drive or just memorized the test routes. Prior work (CARLA Leaderboard, NoCrash, etc.) reports high success rates, but these numbers conflate generalization with memorization. The field lacks a way to isolate and quantify how models degrade under distribution shifts—the very shifts that matter in real-world deployment.

Problem: Test = Train scenarios
    |
    v
Assumption: Success rates measure memorization + generalization (confounded)
    |
    v
Method: Paired routes (shifted vs in-distribution)
    |
    v
Evidence: 22.8% average success drop on shifted routes
    |
    v
Conclusion: SOTA models memorize, don't generalize

The Increment

One sentence: Before this paper, we had high benchmark scores masking memorization; after, we have a diagnostic tool that isolates generalization failure and quantifies it route-by-route.

Core Mechanism

Fail2Drive constructs 200 route pairs in CARLA. Each pair has an in-distribution route (similar to training) and a shifted route (same start/end, different challenge). The shifts span four categories: appearance (weather, lighting), layout (new intersections, road structures), behavioral (aggressive pedestrians, unpredictable vehicles), and robustness (sensor noise, actuator lag).

The pairing is the key structural innovation. By matching routes on everything except the shift variable, the benchmark turns qualitative failure (“the model crashed”) into quantitative diagnosis (“the model’s success rate drops 35% under fog”). Each route also comes with a privileged expert policy that validates solvability—if the expert can’t solve it, the route is discarded.

The toolbox automates scenario creation using CARLA’s scenario runner. Researchers define shift parameters (e.g., “add jaywalking pedestrian at intersection”), and the system generates routes, validates them with the expert, and packages them for evaluation. This makes the benchmark extensible: new shift types can be added without redesigning the entire framework.

Structural metaphor: Think of Fail2Drive as a medical stress test for driving models. The in-distribution route is the baseline EKG—the patient at rest. The shifted route is the treadmill test—same patient, elevated heart rate. The pairing isolates the effect of stress. If the EKG flatlines under load, you know the heart (model) has a specific weakness. The expert policy is the cardiologist who confirms the test is medically valid before you run it. The toolbox is the protocol manual that lets other hospitals (researchers) replicate the test with new stress conditions.

Key Concepts

• Paired-route isolation: Traditional benchmarks mix many variables (route geometry, traffic density, weather) in each test. When a model fails, you can’t pinpoint why. Fail2Drive pairs each shifted route with an in-distribution twin that differs only in the shift variable. If the model succeeds on Route A (sunny, normal traffic) but fails on Route A’ (foggy, same traffic), the failure is attributable to fog. This turns debugging from guesswork into differential diagnosis. Imagine testing a bridge: you don’t just load it until it breaks; you load it incrementally and measure deflection at each step to find the weak joint.

• Privileged expert policy: A common benchmark pitfall is including unsolvable scenarios. If a route requires clairvoyance (e.g., predicting a hidden pedestrian), models fail for the wrong reason. Fail2Drive uses a privileged expert with access to ground-truth future states. If the expert can’t solve a route, it’s removed. This ensures failures reflect model limitations, not task impossibility. Think of it as a control group in drug trials: the expert is the healthy patient who proves the treatment (route) is survivable before testing it on the sick (models).

• Closed-loop generalization: Open-loop evaluation (predict next action given a recorded trajectory) is cheap but misleading—models never face their own mistakes. Closed-loop evaluation runs the model in the simulator, where errors compound. A small steering mistake at t=0 puts the car in the wrong lane at t=5, triggering a cascade. Fail2Drive measures closed-loop performance under distribution shift, the hardest test. It’s the difference between a pilot practicing in a flight simulator (closed-loop, mistakes matter) versus watching cockpit videos (open-loop, no consequences).

Framework Shift

Before (mainstream approach):        After (this paper):

Train scenarios                      Train scenarios
    |                                    |
    v                                    v
Test on same scenarios               Test on paired routes:
    |                                    |
    v                                    +---> In-distribution route
High success rate                        |         |
    |                                    |         v
    v                                    |     Success rate A
"Model works!"                           |
(memorization + generalization)          +---> Shifted route
                                              |         |
                                              |         v
                                              |     Success rate B
                                              |
                                              v
                                          Delta = A - B
                                              |
                                              v
                                      Isolated shift effect

One sentence: From opaque aggregate scores to paired differential measurements, the core shift is making generalization failure observable and attributable.

Expert Assessment

Problem choice: This is a real gap. The field has been celebrating 90%+ success rates on benchmarks that recycle training data. Fail2Drive doesn’t invent a new problem—it exposes an existing measurement flaw. The timing is right: as models scale up, the cost of deploying a memorizer (versus a generalizer) grows catastrophic. The problem sits at the intersection of benchmarking rigor and safety-critical deployment, which is exactly where autonomous driving research needs scrutiny.

Method maturity: The paired-route design is elegant and underutilized in robotics benchmarks. The privileged expert is a smart safeguard against unsolvable scenarios. However, the method is more curation than algorithmic innovation—it’s a benchmark, not a model. The 17 scenario classes are hand-designed, which limits coverage. A stronger version would include a generative process for shift discovery (e.g., adversarial scenario synthesis). The toolbox is a nice touch, but the real test is whether the community adopts it.

Experimental integrity: The baselines are fair—they evaluate multiple SOTA models (TransFuser, InterFuser, TCP) under identical conditions. The 22.8% average drop is stark and consistent across models, which strengthens the claim. One concern: the paper doesn’t report variance across route pairs. If a few hard routes dominate the drop, the average is misleading. The privileged expert validation is a strength, but the paper doesn’t discuss expert failure rates (how many routes were discarded?). This omission makes it hard to assess scenario difficulty calibration.

Writing quality: The paper is well-structured, but the results section is dense with tables. A single figure showing per-model degradation across shift types would clarify the narrative. The related work section undersells the novelty—it reads like a literature review, not a positioning statement. Rewriting it to emphasize “why existing benchmarks can’t measure what we measure” would sharpen the contribution. The failure mode analysis (models ignoring LiDAR objects) is buried in the appendix; promoting it to the main text would make the paper more memorable.

Verdict: Weak accept — The benchmark addresses a real gap and the paired-route design is sound, but the contribution is incremental (better measurement, not new methods). The experimental integrity is solid, though variance reporting is missing. The paper will be useful to the community, but it’s not a paradigm shift.

Takeaways

For benchmark designers: The paired-route pattern is generalizable. If you’re evaluating any system under distribution shift (vision models, NLP, robotics), pair each test case with an in-distribution control. This isolates the shift effect and turns qualitative failure into quantitative diagnosis. The privileged expert pattern is also portable—use a ground-truth oracle to validate that your test cases are solvable before blaming the model.

For model developers: The failure modes are instructive. Models ignore LiDAR objects and fail to learn free/occupied space—these are not edge cases, they’re fundamental concept gaps. If your model succeeds on standard benchmarks but fails here, you’re overfitting to scenario structure, not learning driving. The 22.8% drop is a calibration point: if your model doesn’t degrade this much, you’re either more robust or your training data already covers these shifts.

For practitioners: Don’t trust aggregate success rates on benchmarks where test scenarios resemble training. Demand paired evaluations or at least held-out scenario classes. The paper’s toolbox (open-sourced) lets you create custom shift scenarios—use it to stress-test your models before deployment. The lesson generalizes: memorization looks like generalization until you measure them separately.