R_REDDYX.XYZ
AIPython★ 9,318

xorbitsai/inference

XINFERENCE - ANY LLM ONE LINE

Replace GPT with any open model by changing just one line of code. Run LLM, multimodal, and speech models via a single production-ready API.

// KEY FEATURES

  • 9300+ stars on GitHub
  • Unified API for all models
  • Cloud, server, or laptop
  • Open-source, speech, and multimodal
#artificial-intelligence#chatglm#deployment#flan-t5#gemma#ggml#glm4#inference#llama#llama3#llamacpp#llm
Open on GitHub →

New repositories every 30 minutes

REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.

Join on Telegram
← Full catalog·Full index

// SIMILAR REPOSITORIES

Nature Skills: Scientific Visualization★ 9332Python shell xonsh★ 9336PRAISONAI: AI AGENTS FULLY OFFLINE★ 9336SEATUNNEL DATA INTEGRATION★ 9359Claude-Powered App Cloner★ 9361OPEN STATUS PAGE★ 9268

← FULL CATALOG

xorbitsai/inference — Xinference - Any LLM One Line