R_REDDYX.XYZ

Agent Evaluation: open-source projects on GitHub

13 repositories on Agent Evaluation, picked by the REDDYX AI agent. Each has a summary, key features and a breakdown. Sorted by stars.

// RELATED TOPICS

AI Agents 1319LLM 2094LLM Evaluation 45Agentic AI 378MCP 1601LLM Agents 78Evaluation 46LLMOps 82Benchmark 54Agent Observability 17LLM Observability 24Observability 92Browser Automation 72Browser Use 23
coze-dev/coze-loop

AI Agent Lifecycle Platform

Next-generation AI Agent Optimization Platform: Cozeloop tackles AI agent development challenges with full lifecycle management from development and debugging to evaluati

★ 5,471 · Go
Giskard-AI/giskard-oss

GISKARD-OSS - LLM AGENT EVALUATION

Library for evaluating and testing LLM agents with open-source code.

★ 5,417 · Python
TIGER-AI-Lab/ClawBench

ClawBench - Benchmark for AI Agents

Open-source benchmark for evaluating browser AI agents on everyday tasks. Already earned ⭐ 385!

★ 1,301 · Python
NVIDIA/SkillEvaluator

SKILLEVALUATOR: AI AGENT EVALUATION

A multi-level framework for evaluating AI agent skills: qualitative gates, semantic overlap, synthetic data, and live testing.

★ 1,286 · Python
mozilla-ai/any-agent

ONE INTERFACE FOR ALL AGENTS

any-agent unifies work with LangGraph, CrewAI, Autogen, etc. Allows switching frameworks without rewriting logic. Supports A2A and MCP for interoperability.

★ 1,258 · Python
benchflow-ai/awesome-evals

AI Agent Evaluation Toolkit

A curated library of top resources for building and evaluating AI agents, including articles, blogs, tools, and benchmarks.

★ 1,039
jwuthri-cloud/Tracely-ai

TRACE-NATIVE CI/CD FOR AI AGENTS

Tracely-ai grades production agent traces, clusters failures, and turns them into regression tests. Blocks PRs with behavior regression. Self-hosted on your infrastructur

★ 948 · Python
reacher-z/Awesome-CUA

Curated Computer-Use Agent Resources

Open catalog of computer-use agents with reviewed papers, GUI models, datasets, benchmarks, and tools. Includes reusable JSONL and SQLite data.

★ 880 · Python
TIGER-AI-Lab/WebsiteBench

WEBSITE RECONSTRUCTION BENCHMARK FOR AGENTS

Benchmark for evaluating the ability of AI agents to reconstruct full-featured websites through browser exploration. Contains 70 tasks with 46,916 hidden test cases for v

★ 476 · Python
zgcagi/Harness-RSI

HARNESS-RSI: AGENT SELF-EVOLUTION & EVALUATION

Harness-RSI is a bibliographic project on recursive AI agent self-improvement. Contains theory, evaluation methods, evidence, and bilingual reading list. 431 GitHub stars

★ 446 · TeX
scaleapi/agentenv-framework

Agent Environment Framework

Framework for building realistic reinforcement learning environments with collaboration tools for researchers and engineers.

★ 438 · Python
roy-tong/verovo

VERIFY AI AGENTS BILLS

Verovo verifies AI agent charges and confirms delivery results. Local CLI recounts supported billings, while Buyer Ledger catalogs 26 tool billing models.

★ 219 · Python
amitshekhariitbhu/ai-agents-tutorial

COMPLETE GUIDE TO AI AGENTS

The project guides from function calling to multi-agent systems and orchestration. Step-by-step lessons cover agent loops, evaluation, and multi-agent patterns. Perfect f

★ 212

New projects on this topic in Telegram

Telegram →
Agent Evaluation — 13 open-source GitHub projects | REDDYX AI