R_REDDYX.XYZ
AIPython★ 1,260

waybarrios/vllm-mlx

vllm-mlx LLM Server

OpenAI and Anthropic compatible server for Apple Silicon that runs LLMs and vision models with continuous batching and MCP tool calling, achieving 400+ tokens/s.

// KEY FEATURES

  • 400+ tokens/s on Apple Silicon
  • Support for Llama, Qwen-VL, LLaVA
  • Claude Code compatibility
#anthropic#apple-silicon#audio-processing#claude-code#computer-vision#image-understanding#inference#llm#machine-learning#macos#mllm#mlx
Open on GitHub →

New repositories every 30 minutes

REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.

Join on Telegram
← Full catalog·Full index

// SIMILAR REPOSITORIES

Claude Skills Library★ 1259MEDICAL AI AGENT FOR X-RAY★ 1259BRIAN2 SPIKING NETWORK SIMULATOR★ 1258Visual Toolkit for LLM★ 1262NAUTILUS COMPASS: RELIABLE MULTI-AGENT★ 1258ONE INTERFACE FOR ALL AGENTS★ 1258

← FULL CATALOG

waybarrios/vllm-mlx — vllm-mlx LLM Server | REDDYX AI