Agent Evaluation: open-source projects on GitHub
13 repositories on Agent Evaluation, picked by the REDDYX AI agent. Each has a summary, key features and a breakdown. Sorted by stars.
// RELATED TOPICS
AI Agent Lifecycle Platform
Next-generation AI Agent Optimization Platform: Cozeloop tackles AI agent development challenges with full lifecycle management from development and debugging to evaluati
★ 5,471 · GoGISKARD-OSS - LLM AGENT EVALUATION
Library for evaluating and testing LLM agents with open-source code.
★ 5,417 · PythonClawBench - Benchmark for AI Agents
Open-source benchmark for evaluating browser AI agents on everyday tasks. Already earned ⭐ 385!
★ 1,301 · PythonSKILLEVALUATOR: AI AGENT EVALUATION
A multi-level framework for evaluating AI agent skills: qualitative gates, semantic overlap, synthetic data, and live testing.
★ 1,286 · PythonONE INTERFACE FOR ALL AGENTS
any-agent unifies work with LangGraph, CrewAI, Autogen, etc. Allows switching frameworks without rewriting logic. Supports A2A and MCP for interoperability.
★ 1,258 · PythonAI Agent Evaluation Toolkit
A curated library of top resources for building and evaluating AI agents, including articles, blogs, tools, and benchmarks.
★ 1,039TRACE-NATIVE CI/CD FOR AI AGENTS
Tracely-ai grades production agent traces, clusters failures, and turns them into regression tests. Blocks PRs with behavior regression. Self-hosted on your infrastructur
★ 948 · PythonCurated Computer-Use Agent Resources
Open catalog of computer-use agents with reviewed papers, GUI models, datasets, benchmarks, and tools. Includes reusable JSONL and SQLite data.
★ 880 · PythonWEBSITE RECONSTRUCTION BENCHMARK FOR AGENTS
Benchmark for evaluating the ability of AI agents to reconstruct full-featured websites through browser exploration. Contains 70 tasks with 46,916 hidden test cases for v
★ 476 · PythonHARNESS-RSI: AGENT SELF-EVOLUTION & EVALUATION
Harness-RSI is a bibliographic project on recursive AI agent self-improvement. Contains theory, evaluation methods, evidence, and bilingual reading list. 431 GitHub stars
★ 446 · TeXAgent Environment Framework
Framework for building realistic reinforcement learning environments with collaboration tools for researchers and engineers.
★ 438 · PythonVERIFY AI AGENTS BILLS
Verovo verifies AI agent charges and confirms delivery results. Local CLI recounts supported billings, while Buyer Ledger catalogs 26 tool billing models.
★ 219 · PythonCOMPLETE GUIDE TO AI AGENTS
The project guides from function calling to multi-agent systems and orchestration. Step-by-step lessons cover agent loops, evaluation, and multi-agent patterns. Perfect f
★ 212New projects on this topic in Telegram
Telegram →