R_REDDYX.XYZ
AIJavaScript★ 72⑂ 21 forksApache-2.0

dreamers-laboratory/ai-evaluation-framework

AI Evaluation Framework

A library for comparing models by accuracy, p95 latency, and cost, providing an evaluation of each variable based on reference data.

// KEY FEATURES

  • Measures model accuracy with a detailed breakdown by fields.
  • Computes p95 latency and average inference cost.
  • Compares results against reference ground-truth data for each attribute.
  • Generates JSON/CSV reports compatible with CI/CD pipelines.
Open on GitHub →

New repositories every 30 minutes

REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.

Join on Telegram
← Full catalog·Full index

// SIMILAR REPOSITORIES

PH-Content Content Management★ 72Local AI Generator★ 72Science in Real Time★ 72Streaming Farsi ASR Fine-Tuning★ 72Kairos: Quant Pipeline★ 73WHOOP Offline Companion★ 73

← FULL CATALOG

dreamers-laboratory/ai-evaluation-framework — AI Evaluation…