AIC++★ 2,167
Luce-Org/lucebox-hub
Lucebox Hub
High-speed server for running LLM locally on consumer hardware. Written in C++ for maximum performance.
// KEY FEATURES
- Hardware optimization for ordinary hardware
- Maximum inference speed
- No cloud – everything runs locally
New repositories every 30 minutes
REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.
Join on Telegram