AIRust★ 1,175⑂ 211 forksApache-2.0
chrishayuk/larql
RUST RUNTIME FOR LLM INFERENCE AND EDITING
larql — Rust runtime to run, serve, and edit models. VINDEX3 format makes models executable and inspectable. 1173⭐ on GitHub.
// KEY FEATURES
- Runs and serves LLMs via CLI and HTTP API
- Edits model weights without retraining
- VINDEX3 format: executable, inspectable models
- Metal support on macOS and Hugging Face Hub
#huggingface#inference#llm#mechanistic-interpretability#metal#model-editing#model-interpretability#openai-api#rust#vindex3
Open on GitHub →New repositories every 30 minutes
REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.
Join on Telegram