R_REDDYX.XYZ
AIPython★ 349⑂ 31 forksApache-2.0

lithos-ai/lithos-metal

High-Performance LLM Kernels for Apple

Provides optimized inference kernels and a serving layer for large language models on Apple silicon, enabling fast, low-latency execution in Python.

// KEY FEATURES

  • Accelerates LLM inference with custom Metal kernels on M-series chips.
  • Provides a lightweight Python serving API for deploying models locally.
  • Supports batching and dynamic shape handling for throughput optimization.
Open on GitHub →

New repositories every 30 minutes

REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.

Join on Telegram
← Full catalog·Full index

// SIMILAR REPOSITORIES

AI-FUNCTIONS - Smart Functions for Agents★ 349PYTHON-SDK - SIMPLE SDK FOR ACP★ 349ORKAS: AI VIDEO STUDIO★ 349LAP: Agent API Compass★ 349HUMLa: AI NOTES ON MAC★ 349OYA-BROWSER: BROWSER CONTROL FOR AI AGENTS★ 349

← FULL CATALOG

lithos-ai/lithos-metal — High-Performance LLM Kernels for…