5arXiv cs.AI (Artificial Intelligence)·
DEED framework bridges lab-to-store gap for humanoid retail robots using data-efficient VLA post-training
Researchers present DEED (Data-Efficient Post-Training and Experience-Driven Learning), a systems-level framework for deploying Vision-Language-Action humanoid robots in real retail environments. The approach is evaluated on a supermarket chip-restocking task using a Unitree G1-Edu humanoid and NVIDIA's GR00T N1.6 foundation model, combining data-efficient post-training, experience-driven refinement adapted from RECAP, and a latent-space analysis tool. Key finding: bridging lab-to-real performance gaps is primarily a systems integration challenge rather than an architectural one, achievable with careful data design on a single GPU.
Related guides (3)
Related events (8)
LabVLA: Vision-Language-Action model and RoboGenesis data engine for scientific laboratory robotics
Researchers introduce LabVLA, a Vision-Language-Action model designed to bridge written scientific protocols and physical robot execution in laboratory settings. To address the data scarcity problem, they build RoboGenesis, a simulation-based data engine that composes lab workflows from atomic skills and generates structured demonstrations across robot embodiments. LabVLA uses a two-stage training recipe combining FAST action token pretraining on a Qwen3-VL-4B-Instruct backbone with flow matching posttraining via a DiT action expert. On the LabUtopia benchmark, LabVLA achieves the highest average success rate among evaluated baselines in both in-distribution and out-of-distribution settings.
Bringing Robotics AI to Embedded Platforms: Dataset Recording, VLA Fine-Tuning, and On-Device Optimizations
NXP and Hugging Face describe a pipeline for deploying Vision-Language-Action (VLA) models on embedded/edge hardware, covering dataset recording, fine-tuning, and on-device optimization techniques. The post targets robotics applications where inference must run on resource-constrained microcontrollers or SoCs rather than cloud GPUs. Key topics include quantization, model compression, and integration with the LeRobot ecosystem. This represents a practical engineering bridge between frontier VLA research and real-world embedded robotics deployment.
TREAD: VLM-based re-labelling framework improves robot policy generalization via dataset augmentation
TREAD (Task Robustness via Re-Labelling Vision-Action Robot Data) is a scalable framework that uses pretrained Vision-Language Models to augment existing robotics datasets without new data collection. The approach decomposes demonstrations into sub-tasks, segments videos accordingly, and generates linguistically diverse instruction labels, enriching language-action pair diversity. Evaluations on the LIBERO benchmark show improved generalization to novel tasks and goals, addressing a key limitation of current robot learning policies.
VLK: Synthetic vision-language-kinematics supervision enables humanoid loco-manipulation from egocentric observations
Researchers introduce a pipeline that generates 48,000 paired vision-language-kinematics trajectories synthetically using 3D Gaussian Splatting to reconstruct indoor scenes, bypassing the need for expensive human-annotated robot data. A VLK policy trained on this data predicts whole-body kinematic trajectories from egocentric images and language instructions, which a whole-body tracker converts to physical actions. The approach is validated on a Unitree G1 humanoid performing navigation and object transport, demonstrating viable sim-to-real transfer for perception-based loco-manipulation.
CamVLA: Calibration-free view-robust Vision-Language-Action model for robot deployment
Researchers from Alibaba DAMO Academy introduce CamVLA, a Vision-Language-Action model that eliminates the need for explicit camera calibration during robot deployment. The model decouples manipulation controls from camera geometry by predicting camera-centric end-effector actions and a 6-DoF hand-eye matrix, composing them into robot base-frame actions via deterministic geometric transformation. Operating on a single monocular RGB image without depth or calibration data, CamVLA improves success rates across diverse unseen viewpoints in both simulation and real-world evaluations.
Qwen-VLA: Unified Vision-Language-Action Model Across Robot Tasks, Environments, and Embodiments
Alibaba's Qwen team presents Qwen-VLA, a unified embodied foundation model that extends the Qwen vision-language stack to continuous action and trajectory generation via a DiT-based action decoder. The model is jointly pretrained on diverse data spanning manipulation trajectories, egocentric demonstrations, synthetic simulation, and navigation data, with embodiment-aware prompt conditioning to support multiple robot platforms. A unified action-and-trajectory prediction framework covers manipulation, navigation, and trajectory prediction tasks. Benchmarks show strong results: 97.9% on LIBERO, 73.7% on Simpler-WidowX, 69.0% OSR on R2R navigation, and 76.9% average OOD success in real-world ALOHA experiments.
JoyNexus: Multi-tenant post-training service for Vision-Language-Action models
JoyNexus is a proposed unified service architecture for multi-tenant supervised fine-tuning, reinforcement learning, and evaluation of Vision-Language-Action (VLA) models. The system decouples training, inference, and environment services behind APIs, with shared base models and tenant-isolated policy slots, scheduled via global training and inference queues. A group-batching technique enables a single shared backbone forward pass over heterogeneous VLA data from multiple tenants, reducing aggregate GPU time compared to isolated single-tenant execution. The work targets the inefficiency of exclusive GPU allocation for short or bursty robotics workloads.
CHORUS: Single VLA policy enables decentralized multi-robot collaboration without inter-robot communication
CHORUS is a framework that adapts a single vision-language-action (VLA) backbone to control diverse multi-robot teams in a fully decentralized manner, with each robot running an independent copy conditioned only on its own observations and a robot-identifying prompt. Real-world experiments across tasks like tape measurement, book handovers, and laundry basket lifting show a 64-percentage-point improvement over decentralized from-scratch models and 40-point improvement in reactivity to teammate behavior, while outperforming centralized baselines. The key insight is that pretrained VLA visuomotor priors are sufficient to enable reactive coordination without explicit inter-robot communication or alignment procedures at inference time.