AIPython★ 199⑂ 18 forksMIT
MindLab-Research/Mixture-of-LoRA-Harness
Multi-LoRA Serving Architecture
Routes and composes hundreds of LoRA adapters on a single base model for efficient serving.
// KEY FEATURES
- Routes requests to relevant LoRA adapters dynamically
- Composes multiple adapters per request without merging
- Serves hundreds of adapters on one GPU with low latency
New repositories every 30 minutes
REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.
Join on Telegram