๐Ÿค–Freshcollected in 10m

Relative vs Absolute Joint Actions Boost VLA Performance

PostLinkedIn
๐Ÿค–Read original on Reddit r/MachineLearning

๐Ÿ’กA simple representation change outperformed complex architectural tweaks in a new open-source VLA model.

โšก 30-Second TL;DR

What Changed

Switching to relative joint actions improved average success from 33.7% to 55.0%.

Why It Matters

This finding suggests that representation choices in action space often outweigh architectural complexity in embodied AI, providing a clear optimization path for robotics developers.

What To Do Next

If you are training a manipulation policy, switch your action space from absolute joint targets to relative joint actions before increasing model size.

Who should care:Researchers & Academics

Key Points

  • โ€ขSwitching to relative joint actions improved average success from 33.7% to 55.0%.
  • โ€ขThe model supports 20 robot embodiments and was trained on 60,000 hours of data.
  • โ€ขFeatures a token-level MoE action expert and dual-query distillation from depth and video teachers.
  • โ€ขThe GM-100 benchmark provides a standardized evaluation for bimanual manipulation tasks.

๐Ÿง  Deep Insight

AI-generated analysis for this event.

๐Ÿ”‘ Enhanced Key Takeaways

  • โ€ขThe transition to relative joint actions addresses the 'distribution shift' problem common in cross-embodiment learning, where absolute joint values vary significantly across different robot kinematics.
  • โ€ขLingBot-VLA 2.0 utilizes a novel 'Action-Conditioned Tokenizer' that maps continuous joint deltas into a discrete latent space, facilitating better integration with Large Language Model backbones.
  • โ€ขThe GM-100 benchmark specifically addresses the lack of standardized bimanual evaluation by incorporating 100 diverse tasks ranging from object rearrangement to complex assembly.
  • โ€ขThe dual-query distillation process allows the model to compress high-fidelity depth map information into the visual token stream without increasing inference latency.
  • โ€ขThe model architecture incorporates a 'Kinematic Adapter' layer that allows zero-shot transfer to unseen robot morphologies by normalizing action spaces at the input level.
๐Ÿ“Š Competitor Analysisโ–ธ Show
FeatureLingBot-VLA 2.0Google RT-2Octo-Robot
Action SpaceRelative Joint ActionsAbsolute End-EffectorAbsolute/Relative Hybrid
Training Data60,000 Hours130,000 Episodes800,000 Trajectories
BenchmarkGM-100Open-X EmbodimentOpen-X Embodiment
LicensingOpen SourceResearch OnlyOpen Source

๐Ÿ› ๏ธ Technical Deep Dive

  • Architecture: Transformer-based VLA with a Mixture-of-Experts (MoE) action head that routes tokens to specific kinematic-aware experts.
  • Action Representation: Uses a 7-DOF relative delta encoding scheme, normalizing joint movements to a [-1, 1] range based on robot-specific URDF limits.
  • Distillation: Employs a teacher-student framework where the student model is trained to minimize the KL-divergence between its action distribution and a teacher model conditioned on depth-video fusion.
  • Inference: Optimized for real-time control loops at 20Hz on NVIDIA Jetson Orin platforms.

๐Ÿ”ฎ Future ImplicationsAI analysis grounded in cited sources

Relative action spaces will become the industry standard for cross-embodiment VLA models.
The significant performance gap observed in LingBot-VLA 2.0 provides empirical evidence that absolute coordinate systems hinder generalization across heterogeneous robot hardware.
Bimanual manipulation success rates will increase by at least 15% across the field within 18 months.
The adoption of standardized benchmarks like GM-100 will accelerate iterative improvements in coordination and synchronization for multi-arm systems.

โณ Timeline

2025-03
Robbyant releases LingBot-VLA 1.0 focusing on single-arm manipulation.
2025-11
Initial development of the GM-100 benchmark dataset begins.
2026-04
Robbyant achieves breakthrough in relative joint action mapping during internal testing.
2026-07
Open-source release of LingBot-VLA 2.0 and GM-100 benchmark.
๐Ÿ“ฐ

Weekly AI Recap

Read this week's curated digest of top AI events โ†’

๐Ÿ‘‰Related Updates

AI-curated news aggregator. All content rights belong to original publishers.
Original source: Reddit r/MachineLearning โ†—