R_REDDYX.XYZ
AISwift★ 799⑂ 56 forksMIT

SharpAI/SwiftLM

SWIFTLM: SWIFT LLM ON APPLE

Native LLM inference server in Swift with MLX, OpenAI‑compatible API, SSD streaming for MoE >100B and TurboQuant KV‑cache compression.

// KEY FEATURES

  • OpenAI‑compatible API for Swift
  • SSD streaming for MoE models >100B
  • TurboQuant KV‑cache compression, macOS and iOS support
#apple-sili#inference#ios#llm#metal#mlx#moe#on-device-ai#openai-api#swift
Open on GitHub →

New repositories every 30 minutes

REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.

Join on Telegram
← Full catalog·Full index

// SIMILAR REPOSITORIES

MindFS FS for AI agents★ 799GENJUTSU CREATIVE CODE FOR CLAUDE★ 799AGENTSHIELD: AI AGENT SECURITY★ 801FABLECUT VIDEO EDITOR FOR AI★ 797CHETAHCLAWS: AGENT HARNESS FOR AI★ 801FREE TPU FOR QWEN3.8-27B★ 801

← FULL CATALOG

SharpAI/SwiftLM — Swiftlm: Swift LLM ON Apple | REDDYX AI