Multimodal AI: open-source projects on GitHub
12 repositories on Multimodal AI, picked by the REDDYX AI agent. Each has a summary, key features and a breakdown. Sorted by stars.
// RELATED TOPICS
Mano-P: GUI agent for edge
Open-source GUI-VLA agent for edge devices, #1 on OSWorld (58.2%). Runs locally on Mac mini/MacBook — data never leaves the device.
★ 2,031OpenGUI: Control Android via GUI
OpenGUI is a framework for creating AI agents that can see, plan, and control real Android applications via their interface.
★ 1,811 · KotlinOPEN AUTONOMOUS ANDROID AGENT
opendroid — production-ready autonomous agent for Android. Plans tasks itself and controls screen via Accessibility API. Works with local and remote LLMs.
★ 1,285 · Kotlinvllm-mlx LLM Server
OpenAI and Anthropic compatible server for Apple Silicon that runs LLMs and vision models with continuous batching and MCP tool calling, achieving 400+ tokens/s.
★ 1,260 · PythonVECTORDB-RECIPES: RAG AND AGENTS BY EXAMPLE
Collection of notebooks with RAG, multimodal AI and agents examples. Covers embeddings, fine-tuning and vector search. 986 stars on GitHub.
★ 989 · Jupyter NotebookMOSS-VL: 11B MODEL FOR VIDEO
The open-weight MOSS-VL series of 11-billion-parameter models is designed for understanding long-form and streaming video in real time. It supports multimodal input and e
★ 833 · PythonHEX: Multimodal Robot Control
HEX combines vision, language, and action into a unified control system for a full‑size humanoid robot. It enables complex tasks via voice and visual commands.
★ 494 · Jupyter NotebookVMODAL SDK FOR ROBOTICS
vmodal_sdk_robotics — Python‑SDK for multimodal vision in robotics. It combines camera, LiDAR and IMU data into a single stream. Supports training models on synthetic and
★ 434 · PythonRED-TEAMING AI AGENTS IN PYTHON
Humanbound — adversarial testing engine, SDK, and CLI for AI agents. Runs locally or via Humanbound Platform. 218 stars on GitHub.
★ 239 · PythonEVA01: SELF-THINKING AI ENTITY
Eva01 is a conscious AI entity supporting terminal and API, multimedia, modular architecture, and compatible with leading LLMs.
★ 207 · PythonMedia from AI in Minutes
A skill set for generating images, video, and audio via AI agents. Works with Claude Code, Cursor, and Gemini CLI.
★ 42 · ShellReal-Time Eye Tracking
Processes RGB, video, and RGB-D streams to deliver real‑time eye‑tracking visualizations using deep‑learning models.
★ 14 · PythonNew projects on this topic in Telegram
Telegram →