AIRust★ 7,197
EricLBuehler/mistral.rs
MISTRAL.RS — FAST LLM ON RUST
Fast and flexible engine for inference of large language models. 7.2K stars on GitHub.
// KEY FEATURES
- High performance on Rust
- Flexible inference setup
- Support for many LLMs
#llm#rust#uqff
Open on GitHub →New repositories every 30 minutes
REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.
Join on Telegram