AIPython★ 561
jjang-ai/vmlx
VMLX - NEXT-GEN MLX MODELS
Ultra-fast compressed MLX models with two-level cache, hybrid scheduler, and continuous batching.
// KEY FEATURES
- L2 Disk Cache (survives restart)
- L1 Paged Cache (lightning-fast TTFT)
- Hybrid SSM Scheduler + Cont Batching
#anthropic-api#kvcache-compression#kvcache-optimization#kvcache-reuse#llm#lmstudio#macbook#mcp-server#mlx#mlxllm#mlxstudio#omlx
Open on GitHub →New repositories every 30 minutes
REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.
Join on Telegram