AITypeScript★ 481⑂ 60 forksApache-2.0
modular/llm-inference-handbook
COMPLETE LLM INFERENCE GUIDE
A collection of best practices, tools, and examples for efficient inference of large language models using TypeScript.
// KEY FEATURES
- Step-by-step guides for optimizing LLM speed and cost.
- TypeScript code examples for OpenAI, HuggingFace, and others.
- Comparative benchmarks and recommendations for model selection.
New repositories every 30 minutes
REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.
Join on Telegram