AISwift★ 799⑂ 56 forksMIT
SharpAI/SwiftLM
SWIFTLM: SWIFT LLM ON APPLE
Native LLM inference server in Swift with MLX, OpenAI‑compatible API, SSD streaming for MoE >100B and TurboQuant KV‑cache compression.
// KEY FEATURES
- OpenAI‑compatible API for Swift
- SSD streaming for MoE models >100B
- TurboQuant KV‑cache compression, macOS and iOS support
New repositories every 30 minutes
REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.
Join on Telegram