AIRust★ 7,803⑂ 570 forksApache-2.0
magnitudedev/magnitude
Auto-Tuning ML Inference Engine
Open-source inference engine that auto-tunes kernels per hardware for 2x faster model execution than Ollama across Apple Silicon, NVIDIA, AMD, Intel, and CPU.
// KEY FEATURES
- Auto-tunes kernels on your hardware for optimal model performance
- Runs 2x faster than Ollama on Apple Silicon, NVIDIA, AMD, Intel, and CPU
- Written in Rust with zero runtime dependencies for easy deployment
New repositories every 30 minutes
REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.
Join on Telegram