Relative vs Absolute Joint Actions Boost VLA Performance
๐กA simple representation change outperformed complex architectural tweaks in a new open-source VLA model.
โก 30-Second TL;DR
What Changed
Switching to relative joint actions improved average success from 33.7% to 55.0%.
Why It Matters
This finding suggests that representation choices in action space often outweigh architectural complexity in embodied AI, providing a clear optimization path for robotics developers.
What To Do Next
If you are training a manipulation policy, switch your action space from absolute joint targets to relative joint actions before increasing model size.
Key Points
- โขSwitching to relative joint actions improved average success from 33.7% to 55.0%.
- โขThe model supports 20 robot embodiments and was trained on 60,000 hours of data.
- โขFeatures a token-level MoE action expert and dual-query distillation from depth and video teachers.
- โขThe GM-100 benchmark provides a standardized evaluation for bimanual manipulation tasks.
๐ง Deep Insight
AI-generated analysis for this event.
๐ Enhanced Key Takeaways
- โขThe transition to relative joint actions addresses the 'distribution shift' problem common in cross-embodiment learning, where absolute joint values vary significantly across different robot kinematics.
- โขLingBot-VLA 2.0 utilizes a novel 'Action-Conditioned Tokenizer' that maps continuous joint deltas into a discrete latent space, facilitating better integration with Large Language Model backbones.
- โขThe GM-100 benchmark specifically addresses the lack of standardized bimanual evaluation by incorporating 100 diverse tasks ranging from object rearrangement to complex assembly.
- โขThe dual-query distillation process allows the model to compress high-fidelity depth map information into the visual token stream without increasing inference latency.
- โขThe model architecture incorporates a 'Kinematic Adapter' layer that allows zero-shot transfer to unseen robot morphologies by normalizing action spaces at the input level.
๐ Competitor Analysisโธ Show
| Feature | LingBot-VLA 2.0 | Google RT-2 | Octo-Robot |
|---|---|---|---|
| Action Space | Relative Joint Actions | Absolute End-Effector | Absolute/Relative Hybrid |
| Training Data | 60,000 Hours | 130,000 Episodes | 800,000 Trajectories |
| Benchmark | GM-100 | Open-X Embodiment | Open-X Embodiment |
| Licensing | Open Source | Research Only | Open Source |
๐ ๏ธ Technical Deep Dive
- Architecture: Transformer-based VLA with a Mixture-of-Experts (MoE) action head that routes tokens to specific kinematic-aware experts.
- Action Representation: Uses a 7-DOF relative delta encoding scheme, normalizing joint movements to a [-1, 1] range based on robot-specific URDF limits.
- Distillation: Employs a teacher-student framework where the student model is trained to minimize the KL-divergence between its action distribution and a teacher model conditioned on depth-video fusion.
- Inference: Optimized for real-time control loops at 20Hz on NVIDIA Jetson Orin platforms.
๐ฎ Future ImplicationsAI analysis grounded in cited sources
โณ Timeline
Weekly AI Recap
Read this week's curated digest of top AI events โ
๐Related Updates
AI-curated news aggregator. All content rights belong to original publishers.
Original source: Reddit r/MachineLearning โ



