AIJupyter Notebook★ 494
Open-X-Humanoid/HEX
HEX: Multimodal Robot Control
HEX combines vision, language, and action into a unified control system for a full‑size humanoid robot. It enables complex tasks via voice and visual commands.
// KEY FEATURES
- Generation of joint motion coordinates from an image and textual instruction.
- Real‑time environment perception via RGB‑D cameras and object segmentation.
- Training on large datasets using contrastive loss and transformers.
- Integration with ROS2 for controlling a humanoid robot in simulation and on hardware.
#cross-embodiment#embodied-ai#humanoid-robotics#imitation-learning#multimodal-ai#vision-language-action-model#vla-model#whole-body-manipulation
Open on GitHub →New repositories every 30 minutes
REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.
Join on Telegram