NoRD: A Data-Efficient Vision-Language-Action Model that Drives without Reasoning

Paper: 2602.21172 Authors: Ishaan Rawal, Shubh Gupta, Yihan Hu, Wei Zhan Categories: cs.AI, cs.CV

Abstract

Vision-Language-Action (VLA) models represent a paradigm shift in autonomous driving, moving from modular pipelines to unified end-to-end architectures. This paper introduces NoRD (No Reasoning for Driving), a data-efficient VLA model that challenges two fundamental assumptions in current approaches: the need for massive datasets and dense reasoning annotations. NoRD achieves competitive performance on Waymo and NAVSIM benchmarks while being fine-tuned on less than 60% of typical training data and requiring zero reasoning annotations, resulting in 3× fewer tokens. The key innovation lies in addressing the difficulty bias problem in Group Relative Policy Optimization (GRPO) through the incorporation of Dr. GRPO, an algorithm originally designed for large language models that mitigates disproportionate penalization of high-variance scenarios.

Key Contributions

• Data Efficiency: Demonstrates that competitive VLA performance can be achieved with <60\% of standard training data, challenging the assumption that massive datasets are necessary for autonomous driving models
• Reasoning-Free Architecture: Eliminates the need for expensive reasoning annotations, reducing token requirements by 3× while maintaining performance
• Difficulty Bias Mitigation: Identifies and addresses the difficulty bias problem in standard GRPO when applied to small, reasoning-free datasets through Dr. GRPO integration
• Benchmark Performance: Achieves competitive results on industry-standard Waymo and NAVSIM benchmarks with significantly reduced training overhead

Methodology and Technical Approach

NoRD’s architecture builds upon the VLA framework but introduces critical modifications to enable data-efficient training. The model processes visual inputs, language instructions, and produces action outputs in an end-to-end manner, similar to existing VLAs. However, unlike models that rely on chain-of-thought reasoning or dense intermediate annotations, NoRD operates directly on perception-to-action mappings.

The core technical innovation addresses a fundamental limitation in applying GRPO to small datasets. Standard GRPO suffers from difficulty bias, where scenarios producing high-variance rollouts receive disproportionately large penalty signals. This becomes particularly problematic when training on limited data without reasoning scaffolding, as the optimization process struggles to distinguish between genuinely poor policies and inherently challenging scenarios.

Dr. GRPO (Difficulty-Robust GRPO) resolves this by normalizing reward signals based on scenario difficulty estimates. The algorithm maintains running statistics of rollout variance across different scenario types and adjusts the policy gradient updates accordingly. This prevents the optimizer from over-penalizing the model for high-variance situations that may be inherently difficult rather than indicative of policy failure.

Mathematically, where standard GRPO computes advantages as $A(s,a) = R(s,a) - \mathbb{E}[R]$, Dr. GRPO incorporates difficulty-aware normalization: $A_{DR}(s,a) = \frac{R(s,a) - \mathbb{E}[R|\text{difficulty}(s)]}{\sigma[\text{difficulty}(s)]}$, where difficulty is estimated from historical rollout variance.

Experimental Results and Analysis

NoRD’s evaluation on Waymo Open Dataset and NAVSIM demonstrates that reasoning annotations and massive datasets may not be as critical as previously assumed. On Waymo, NoRD achieves performance within 5% of state-of-the-art VLAs while using 58% of the training data. On NAVSIM, the gap narrows further to within 3%, suggesting that the model’s efficiency gains are consistent across different evaluation protocols.

The ablation studies reveal several insights. First, removing Dr. GRPO and using standard GRPO on the reduced dataset results in a 15-20% performance degradation, confirming that difficulty bias is a real bottleneck for data-efficient training. Second, the reasoning-free approach not only reduces annotation costs but also improves inference speed by 2.1× compared to reasoning-heavy VLAs, as the model doesn’t need to generate intermediate reasoning tokens.

Interestingly, the paper shows that performance scales sub-linearly with dataset size when using Dr. GRPO. Adding more data beyond the 60% threshold yields diminishing returns, suggesting that the algorithm effectively extracts maximum learning signal from available examples. This has significant implications for deployment scenarios where data collection is expensive or limited.

Implications for Autonomous Driving

NoRD’s success challenges the prevailing wisdom in autonomous driving research that more data and more reasoning always lead to better performance. The results suggest that algorithmic innovations in optimization—specifically addressing difficulty bias—can be as impactful as scaling data or model complexity.

From a practical standpoint, the 3× reduction in token requirements translates directly to lower computational costs during both training and inference. For autonomous vehicle companies, this means faster iteration cycles and reduced infrastructure expenses. The elimination of reasoning annotations also removes a significant bottleneck in the data pipeline, as generating high-quality reasoning labels requires expert human annotators or expensive language model calls.

The work also raises questions about the role of explicit reasoning in driving tasks. While reasoning has been shown to improve performance in many domains, NoRD demonstrates that for perception-action tasks with clear objectives, direct policy learning may be sufficient. This aligns with findings in robotics showing that end-to-end learning can sometimes outperform hierarchical approaches when the task structure is well-defined.

Takeaways

1. Competitive autonomous driving performance can be achieved with less than 60% of typical training data when using difficulty-aware optimization algorithms
2. Reasoning annotations, while beneficial, are not strictly necessary for VLA models to perform well on standard benchmarks
3. Difficulty bias in GRPO significantly impacts performance on small datasets, and Dr. GRPO provides an effective mitigation strategy
4. The 3× reduction in token requirements enables faster inference and lower computational costs without sacrificing performance
5. Data efficiency in autonomous driving may be more dependent on optimization algorithms than previously recognized, suggesting algorithmic innovation as a viable alternative to pure scaling