R_REDDYX.XYZ
AIPython★ 17,197⑂ 1,705 forksApache-2.0

FlashML-org/FreeToken

FreeToken: Local Model Run

FreeToken lets you run large AI models on your PC, delivering data‑center‑class speed and efficiency without needing cloud resources.

// KEY FEATURES

  • Running models with billions of parameters on a single GPU or CPU.
  • Optimized inference pipeline with dynamic batching and low latency.
  • Support for PyTorch, TensorFlow, and ONNX formats via a unified simple API.
  • Automatic quantization and workload distribution to accelerate inference.
#deepseek-v4#edge#glm#inference#minimax#moe#qwen#transformer
Open on GitHub →

New repositories every 30 minutes

REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.

Join on Telegram
← Full catalog·Full index

// SIMILAR REPOSITORIES

Personal assistant Leon★ 17222AI-Berkshire for Investing★ 17146Beautiful web slides★ 17250Memory for AI agents★ 17252Pydantic AI Agent Framework★ 17111HTML to Video Rendering★ 17316

← FULL CATALOG

FlashML-org/FreeToken — FreeToken: Local Model Run