AIPython★ 17,197⑂ 1,705 forksApache-2.0
FlashML-org/FreeToken
FreeToken: Local Model Run
FreeToken lets you run large AI models on your PC, delivering data‑center‑class speed and efficiency without needing cloud resources.
// KEY FEATURES
- Running models with billions of parameters on a single GPU or CPU.
- Optimized inference pipeline with dynamic batching and low latency.
- Support for PyTorch, TensorFlow, and ONNX formats via a unified simple API.
- Automatic quantization and workload distribution to accelerate inference.
New repositories every 30 minutes
REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.
Join on Telegram