R_REDDYX.XYZ

Multimodal: open-source projects on GitHub

143 repositories on Multimodal, picked by the REDDYX AI agent. Each has a summary, key features and a breakdown. Sorted by stars.

// RELATED TOPICS

LLM 2094VLM 50Agent 547RAG 533Vision Language Model 28MCP 1602AI Agents 1319Deep Learning 105Large Language Models 154Machine Learning 190Pytorch 98Reinforcement Learning 51Vision 17Computer Vision 41
JosefAlbers/phi

phi - Simple Phi-4 Launch

Run the powerful multimodal Phi-4 model directly on your Mac with Apple Silicon — no cloud, no complex setup.

★ 280 · Jupyter Notebook
kyegomez/NaViT

NAVIT Any‑Format Vision Transformer

Implementation of the Patch n’ Pack paper: NaViT – a Vision Transformer that works with any aspect ratio and resolution without padding.

★ 276 · Python
EvolvingLMMs-Lab/LongVT

LongVT — Think About Video Foundations

A model that learns to 'think' about long videos through built‑in tools for CVPR 2026.

★ 274 · Python
line/lighthouse

🔍 LIGHTHOUSE: VIDEO MOMENT RETRIEVAL

User-friendly library for reproducible video moment retrieval and highlight detection. Also supports audio. Published at EMNLP2024 Demo, ICASSP 2025 and ICASSP 2026.

★ 274 · Python
OmniJev/OneJev

MULTIMODAL DECISION MODEL

OneJev — multimodal System One model for calibrated answers to questions about screens, photos, video and text in one forward pass.

★ 272 · Python
mgonzs13/llama_ros

LLAMA_ROS ROS 2 LLM

The project combines llama.cpp and llava.cpp with ROS 2, allowing the use of GGUF models for real-time robotics.

★ 268 · C++
AtlasCloudAI/awesome-seedance-2.5-prompts-skills

OPTIMIZING PROMPTS FOR SEEDANCE 2.5

More than 100 verified Seedance 2.5 prompts with real video previews. Built-in Agent Skill optimizes prompts, creates storyboards, and generates videos using Seedance mod

★ 268 · TypeScript
tongye98/Awesome-Code-Benchmark

BENCHMARKS FOR CODE FROM LLM

Awesome-Code-Benchmark — an overview of key benchmarks for evaluating language models' coding abilities.

★ 250
ayushh0110/ScreenMind

SCREENMIND - YOUR SCREEN MEMORY

Remembers your screen, searches by content, and chats with AI locally.

★ 249 · Python
yuanzhao-CVLAB/UniMMAD

UNIMMAD ANOMALY DETECTION IN MULTIMEDIA MODEL

UniMMAD offers a unified approach to anomaly detection in multimedia data by combining images, audio, and text. Using mixture‑of‑experts, it performs feature decompressio

★ 248 · Python
pie-project/pie

PIE — MODEL SERVING ON RUST

Programmable engine for high-performance LLM and diffusion model serving. Written in Rust, supports batching, KV caching, and dynamic adapter loading.

★ 240 · Rust
matrix-agent/awesome-agentic-world-modeling

AWESOME AGENTIC WORLD MODELING

The project demonstrates the foundations of agentic world modeling: capabilities, laws, and further development in TypeScript.

★ 235 · TypeScript
withceleste/celeste-python

CELESTE-PYTHON: Multimodal AI Primitives

Type-safe primitives for multimodal AI: work with any models and providers via a unified interface.

★ 228 · Python
gokayfem/ComfyUI-fal-API

ComfyUI Fal API: 1400+ Models

Production-ready custom nodes for ComfyUI, providing access to 1400+ fal.ai models with automatic updates, caching, and cost control.

★ 227 · Python
ZSeven-W/dsh-crew

DSH-CREW: PLUGIN FOR CLAUDE CODE AND CODEX

dsh-crew is a DeepSeek Harness plugin to run agents from Claude Code and Codex. Supports native subagents with progress tracking, worker sessions with presets, and a mult

★ 215 · JavaScript
ForeverBlue816/GRACE

GRACE: INT4 QWEN3-VL DISTILL

Qwen3-VL in INT4 with quantization-aware distillation – ready for deployment.

★ 213 · Jupyter Notebook
Leon-Sander/Local-Multimodal-AI-Chat

LOCAL MULTIMODAL CHAT

Self-hosted chat with local LLMs (Ollama/OpenAI), supporting PDF RAG, image chat, and voice input via Whisper.

★ 209 · Python
florencejt/fusilli

FUSILLI MULTIMODAL FUSION

Fusilli — Python package with ready-made multimodal fusion pipelines: from data loading to model training and evaluation.

★ 205 · Python
JIA-Lab-research/MGM-Omni

MGM-OMNI: FUTURE AI VOICE

MGM-Omni enables scaling large language models for personalized long-form speech, ensuring coherent synthesis for hours ahead.

★ 202 · Python
xiayu1987/noobot

NOOBOT CHEAP AI AGENT

Self‑hosted workspace for AI agents with low cost: support for tool calling, MCP, multi‑model routing and sandboxed execution. Enables creating multi‑agent workflows and

★ 195 · JavaScript
shawn0728/OpenSearch-VL

OpenSearch-VL: Multimodal Search

Open recipe for training deep multimodal search agents with data curation, visual tools, and RL.

★ 190 · Python
SimpleJev/JevAny

System 1 Model Framework

Framework to train, test, and serve System 1 decision models on language and multimodal platforms.

★ 137 · Python
couragec/LLMInternSkill

LLM Intern Skill

This project provides a set of LLM-based tools for improving resumes, matching jobs, fact-checking experience, and preparing for interviews.

★ 96 · Markdown

New projects on this topic in Telegram

Telegram →
Multimodal — page 3 | REDDYX AI