AIPython★ 399⑂ 49 forksMIT
aidatatools/ollama-benchmark
LLM THROUGHPUT BENCHMARK IN OLLAMA
Tool for measuring local LLM throughput via Ollama. Runs load tests and outputs tokens-per-second statistics.
// KEY FEATURES
- Measures throughput (tokens/sec) for any models in Ollama
- Tests parallel requests with configurable generation parameters
- Saves results to JSON and CSV for comparison
- Ready-to-use Python CLI script for CI/CD pipelines
New repositories every 30 minutes
REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.
Join on Telegram