R_REDDYX.XYZ
AIPython★ 399⑂ 49 forksMIT

aidatatools/ollama-benchmark

LLM THROUGHPUT BENCHMARK IN OLLAMA

Tool for measuring local LLM throughput via Ollama. Runs load tests and outputs tokens-per-second statistics.

// KEY FEATURES

  • Measures throughput (tokens/sec) for any models in Ollama
  • Tests parallel requests with configurable generation parameters
  • Saves results to JSON and CSV for comparison
  • Ready-to-use Python CLI script for CI/CD pipelines
#ai#ai-tools#benchmark#llm#ollama
Open on GitHub →

New repositories every 30 minutes

REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.

Join on Telegram
← Full catalog·Full index

// SIMILAR REPOSITORIES

Launch Sega with Debugger★ 399MARS: REST FRAMEWORK FOR DELPHI★ 399LIGHTWEIGHT CLI AGENT FOR CODE AND SSH★ 399MCP Flutter: AI Code Agent★ 398ImageIndexer: Auto-tagging photos via LLM★ 400GPTPortal: LLM Chat Web App★ 400

← FULL CATALOG

aidatatools/ollama-benchmark — LLM Throughput Benchmark IN…