Paper: 2604.19728 Authors: Jean Mercat, Sedrick Keh, Kushal Arora, et al. (Toyota Research Institute) Categories: cs.AI, cs.RO, cs.CV
Problem
Most open-source VLA efforts specialize on action training stage, often stitching together incompatible pretraining pipelines. This limits reproducibility and flexibility.
VLA Foundry
An open-source framework that unifies LLM, VLM, and VLA training in a single codebase:
- Shared training stack with end-to-end control
- From language pretraining to action-expert fine-tuning
- Supports both from-scratch training and pretrained backbones from HuggingFace
Training Pipeline
LLM → VLM → VLA
- Language Pretraining: Standard LLM training
- Vision-Language Alignment: Connect vision encoder to LLM
- Action Expert Fine-tuning: Add robotics capabilities
Released Models
Two types trained and released:
- Fully from-scratch model: Through LLM→VLM→VLA pipeline
- Qwen3-VL backbone model: Built on pretrained Qwen3-VL
Evaluation
Evaluated on LBM Eval (open-data, open-source simulator):
- From-scratch model on par with prior closed-source work
- Qwen3-VL backbone achieves strong multi-task tabletop manipulation, outperforming baseline
Takeaways
- Unified framework enables reproducible VLA research
- Pretrained backbones accelerate development
- Open-source release promotes community collaboration
论文: 2604.19728 作者: Jean Mercat, Sedrick Keh, Kushal Arora等（丰田研究院） 分类: cs.AI, cs.RO, cs.CV
问题
大多数开源VLA工作专注于动作训练阶段，经常将不兼容的预训练管道拼接在一起。这限制了可复现性和灵活性。
VLA Foundry
一个在单一代码库中统一LLM、VLM和VLA训练的开源框架：
- 具有端到端控制的共享训练栈
- 从语言预训练到动作专家微调
- 支持从零训练和HuggingFace预训练骨干
训练管道
LLM → VLM → VLA
- 语言预训练：标准LLM训练
- 视觉-语言对齐：将视觉编码器连接到LLM
- 动作专家微调：添加机器人能力
发布的模型
训练并发布了两类模型：
- 完全从零训练的模型：通过LLM→VLM→VLA管道
- Qwen3-VL骨干模型：建立在预训练Qwen3-VL上
评估
在LBM Eval（开放数据、开源模拟器）上评估：
- 从零训练的模型与先前闭源工作相当
- Qwen3-VL骨干实现强多任务桌面操作，优于基线
要点总结
- 统一框架实现可复现的VLA研究
- 预训练骨干加速开发
- 开源发布促进社区协作