AIJavaScript★ 72⑂ 21 forksApache-2.0
dreamers-laboratory/ai-evaluation-framework
AI Evaluation Framework
A library for comparing models by accuracy, p95 latency, and cost, providing an evaluation of each variable based on reference data.
// KEY FEATURES
- Measures model accuracy with a detailed breakdown by fields.
- Computes p95 latency and average inference cost.
- Compares results against reference ground-truth data for each attribute.
- Generates JSON/CSV reports compatible with CI/CD pipelines.
New repositories every 30 minutes
REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.
Join on Telegram