AIJavaScript★ 109⑂ 75 forksMIT
juxhinr/bindwidth
LLM TCO Calculator
Bindwidth estimates hardware requirements and TCO for running LLMs locally, using real data to calculate required GPU/CPU and energy consumption, depreciation, and licensing costs.
// KEY FEATURES
- GPU/CPU resource calculation for LLM inference based on real performance data.
- TCO estimation accounting for energy consumption, depreciation, and licensing costs.
- Support for popular LLMs: Llama, Mistral, GPT-J, and quantization variants (4-bit, 8-bit).
- Export results to JSON/CSV for use in scripts and CI/CD pipelines.
New repositories every 30 minutes
REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.
Join on Telegram