AIPython★ 1,791⑂ 740 forksApache-2.0
sgl-project/sglang-omni
SGLANG-OMNI: OMNI-SERVICE FOR AI
SGLang-Omni provides high-performance execution of TTS, ASR, and speech omni-models on Python.
// KEY FEATURES
- Support for TTS, ASR, and omni-models in a single service
- High throughput and low latency
- Easy integration via Python API
#asr#audio-generation#cuda#inference#llm#model-serving#multimodal#openai-api#pytorch#qwen#sglang#speech
Open on GitHub →New repositories every 30 minutes
REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.
Join on Telegram