R_REDDYX.XYZ
AIPython★ 3,123

thu-pacman/chitu

CHITU: ACCELERATING LLMS IN PYTHON

High-performance framework for fast inference of large language models in Python. Provides flexibility, efficiency, and ease of deployment.

// KEY FEATURES

  • Optimized engine for low latency
  • Support for multiple backends and devices
  • Simple API with flexible configuration
#deepseek#gpu#llm#llm-serving#model-serving#pytorch
Open on GitHub →

New repositories every 30 minutes

REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.

Join on Telegram
← Full catalog·Full index

// SIMILAR REPOSITORIES

Combine Multiple Internet Connections★ 3121AI VIDEO EDITOR★ 3127AI MULTI-AGENT FRAMEWORK IN .NET★ 3117QUANT-MIND: Smart Data Extraction★ 3136CLODDSBOT – AI TRADING AGENT★ 3110WINDSURFAPI - PROXY FOR LLM API★ 3140

← FULL CATALOG

thu-pacman/chitu — Chitu: Accelerating Llms IN Python