AIPython★ 9,318
xorbitsai/inference
XINFERENCE - ANY LLM ONE LINE
Replace GPT with any open model by changing just one line of code. Run LLM, multimodal, and speech models via a single production-ready API.
// KEY FEATURES
- 9300+ stars on GitHub
- Unified API for all models
- Cloud, server, or laptop
- Open-source, speech, and multimodal
#artificial-intelligence#chatglm#deployment#flan-t5#gemma#ggml#glm4#inference#llama#llama3#llamacpp#llm
Open on GitHub →New repositories every 30 minutes
REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.
Join on Telegram