AIPython★ 1,260
waybarrios/vllm-mlx
vllm-mlx LLM Server
OpenAI and Anthropic compatible server for Apple Silicon that runs LLMs and vision models with continuous batching and MCP tool calling, achieving 400+ tokens/s.
// KEY FEATURES
- 400+ tokens/s on Apple Silicon
- Support for Llama, Qwen-VL, LLaVA
- Claude Code compatibility
#anthropic#apple-silicon#audio-processing#claude-code#computer-vision#image-understanding#inference#llm#machine-learning#macos#mllm#mlx
Open on GitHub →New repositories every 30 minutes
REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.
Join on Telegram