R_REDDYX.XYZ
AIPython★ 14,445

jundot/omlx

LLM Server for Apple Silicon

A powerful inference server with support for continuous batching and SSD caching, running on Apple Silicon and controlled via the macOS menu bar.

// KEY FEATURES

  • Continuous batching
  • SSD caching for speed
  • Integration with macOS menu
#apple-silicon#inference-server#llm#macos#mlx#openai-api
Open on GitHub →

New repositories every 30 minutes

REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.

Join on Telegram
← Full catalog·Full index

// SIMILAR REPOSITORIES

ALL IN ONE: COURSES AND VIDEO★ 14442Skills for Claude Code★ 14430AI website cloner★ 14490AI-RESEARCH-SKILLS: 9.7K STARS★ 14571Memori: Memory for AI agents★ 14573Hermes Desktop Companion★ 14578

← FULL CATALOG

jundot/omlx — LLM Server for Apple Silicon | REDDYX AI