R_REDDYX.XYZ
AIRust★ 1,175⑂ 211 forksApache-2.0

chrishayuk/larql

RUST RUNTIME FOR LLM INFERENCE AND EDITING

larql — Rust runtime to run, serve, and edit models. VINDEX3 format makes models executable and inspectable. 1173⭐ on GitHub.

// KEY FEATURES

  • Runs and serves LLMs via CLI and HTTP API
  • Edits model weights without retraining
  • VINDEX3 format: executable, inspectable models
  • Metal support on macOS and Hugging Face Hub
#huggingface#inference#llm#mechanistic-interpretability#metal#model-editing#model-interpretability#openai-api#rust#vindex3
Open on GitHub →

New repositories every 30 minutes

REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.

Join on Telegram
← Full catalog·Full index

// SIMILAR REPOSITORIES

AWS SKILLS FOR AI AGENTS★ 1175ENTERPRISE DEEP RESEARCH - DATA RESEARCH WITHOUT LIMITS★ 1174MCP SERVER FOR DAVINCI RESOLVE★ 1176Hand-drawn CSS annotations★ 1176SMALL ENGINEER ROBOT WITH AI ASSISTANT★ 1176GUFO: INFERENCE ENGINE FOR STRIX HALO★ 1176

← FULL CATALOG

chrishayuk/larql — Rust Runtime For LLM Inference And Editing