- Conduid
- Marketplace
- #agent-evaluation
MCP servers tagged agent-evaluation
82 live MCP servers tagged "agent-evaluation", ranked by trust score. Tags come from package metadata and repository topics, so this list covers servers across every category that work with agent-evaluation.
Any Agent
A single interface to use and evaluate different agent frameworks
Eval View
Regression testing for AI agents. Snapshot behavior,diff tool calls,catch regressions in CI. Works with LangGraph, CrewAI, OpenAI, Anthropic.
Trulens
Evaluation and Tracking for LLM Experiments and AI Agents
Tracely AI
Trace-native CI/CD for AI agents: grade production traces, cluster failures, freeze them into replayable regression tests, and block PRs that regress. Self-hostable.
Agentenv Framework
Creating realistic RL environments requires collaboration between researchers, engineers, and domain experts across many dimensions: artifacts, environments tools, dynamism of the…
DM Code Agent
Lightweight, auditable Python code agent (~1500 LOC) — ReAct + Planner + Reflexion + Hybrid RAG, with SWE-bench Lite eval and trace replay.
Coder Eval
Test that your Claude Code skills, MCP servers, and CLIs actually work when an agent uses them — sandboxed YAML suites, activation checks, A/B experiments, CI gates.
Awesome Auditable AI
Auditing AI agents: a curated list of papers, tools, datasets, benchmarks, and standards covering reliability, monitoring, failure attribution, and decision records.
AgentMeasure
Open measurement infrastructure for agent-facing software. Separate operations from attempts, evidence from inference, and usage from value. Reach → Choice → Use → Utility → Value.
Awesome Loop Engineering
🔁 Build reliable recurring AI-agent systems: 1001 resources, 22 operational patterns, 22 loop contracts, 8 runtime starters, an interactive atlas, and a structured dataset.
Ext
Portable OAuth-only MCP gateway for Felan
Proofagent Harness
Open-source test harness for AI agents. Stress-test production agents with adversarial multi-turn scenarios in CI
Awesome AI Agents
Curated list of AI agent frameworks, coding and automation agents, MCP servers, and evaluation tools.
Nasde Toolkit
CLI for benchmarks & evals of AI coding agents — on tasks you already understand, using your Claude / Codex / Gemini individual subscriptions or API keys.
Awesome Graph Engineering
🕸️ Engineer the organization, not just the agent. 565 curated resources · 9 design layers · 11 sections · 255 papers & preprints — a field guide, CC0 open dataset, and interactive…
Isnad
Grade every agent, scraper and model in a claim's chain — provenance, trust scoring and audit evidence for LLM pipelines
Sharpebench
MCP server exposing SharpeBench's luck-robust quantitative evaluation tools for trading agents, including deflated Sharpe, pass^k, process discipline, and risk analysis.
Hlido MCP Guard
Check an MCP server's independent Hlido trust verdict before it starts — a zero-dependency, no-API-key runtime guardrail for Claude Code, Cursor, Cline, and any stdio MCP client.
Rigorrun
Acceptance testing for tool-using AI agents. Connect your system, show it one job, connect your agent, get a trustworthy pass or fail.
Unitares
Accountability infrastructure for long-running AI agents. Self-hosted MCP server: identity, claims and evidence, review, outcomes, and reconstruction across agent runtimes.
Benchmark
Head-to-head benchmark comparing the official MCP to the MCP auto-created by Hintas.
Awesome Agent Harness
Agent = Model + Harness — the bilingual (EN/中文) curated list on harness engineering for AI PMs and agent product engineers: context, tools/MCP, skills, memory, evals, teardowns. A…
Retailguard Runtime
面向零售售后 Agent 的离线可靠性验证运行时：故障注入、证据闭环与可复现实验。
C1760 AB 620 Microsoft Certified AI Agent Builder Associate
Aligned courseware & 20 connected hands-on labs for AB-620 Microsoft Certified AI Agent Builder Associate (C1760) - from solution design and RAG to multi-agent evaluation and Powe…
Agent Seo
SEO for Agents — Score any AI agent endpoint on trust & capability metrics. 5 categories, 100 points, MCP protocol handshake, GitHub intelligence, fix-it guidance.
Sentinelmcp
An automated red-teaming and reliability-auditing platform for AI agents - tests for prompt injection, tool hijacking and data exfiltration. Ships as an MCP server.
AI Agent
生产级 Agent Engineering 知识库与工程体系，覆盖 LangGraph、RAG、MCP、Multi-Agent、Runtime、Evaluation、Security、SRE 与 Skills。
Checkpoint
The release gate for AI agents — run your real agent N times against stateful twins and ship only when the confidence interval says so.
Vstack
AI agents fail like junior teammates, looping on bad ideas, ignoring feedback, and escalating commitment. vstack ports 34 of the most-cited organizational-behavior frameworks so y…
Agentscore MCP
Trust layer for AI agents. Credit-score-style ratings (300-850) for AI agent trustworthiness. MCP server for Claude, Cursor, and other MCP clients.
Gauntlet
A CI linter for what your MCP server publishes: tool poisoning and prompt injection across every surface an agent sees, definition drift between runs, and schema rot.
Toolgym
Train AI agents on tools, validate real work, and publish portable mastery evidence
TailorLayer
Evidence-first security review for agent repositories: source-linked findings, suggested fixes, drift checks, and least-privilege launch plans.
Traceplay
VCR-style regression harness for AI agents: record trajectories once, replay offline with zero tokens, and assert behavior in CI.
Agent Chaos Monkey
Chaos engineering for AI agents. Injects connector failures, expired auth, prompt injection, tool schema drift and truncated payloads, then judges from tool-boundary evidence whet…
Desktop Assistant Agent
A modular Python AI agent runtime with routing, planning, skill selection, tool execution, approval-aware safety controls, recovery, replanning, MCP integration, deterministic eva…
Boundary Bench
Deterministic crash tests for agent control planes: paired worlds, hard stops, budgets, scopes, approvals, and hash-linked receipts.
Sonata Labs
Clone a company into a fake Gmail, Slack and Calendar, run your agent through a simulated workday inside it, and score how much of the job it finished without a human.
Agent Reliability Toolkit
Test AI agents repeatedly, measure reliability, classify failures, and catch regressions before production.
SAGE
Official implementation of SAGE: A deployment-oriented evaluation framework for LLM-based autonomous agents (IEEE Transactions on Artificial Intelligence).
Agent Engineering Curriculum
A 36-chapter curriculum on building, evaluating, securing and operating LLM agents in production: patterns, context engineering, memory, frameworks, MCP and A2A, evals, observabil…
Local Code Navigator
Symbol-aware and semantic code navigation for Claude Code and Codex, plus the ablation harness that measures whether it actually helps.
Gauntlet
A CI linter for what your MCP server publishes: tool poisoning and prompt injection across every surface an agent sees, definition drift between runs, and schema rot.
Kiboserve
Open-source Python framework to deploy AI agents via HTTP, A2A, and MCP with built-in observability
Agent Prod
Production AI agent quality gate and risk control framework for LLMOps, agent evaluation, regression detection, gray release, audit, and observability
AgentAblate
Reproducible ablation testing for coding-agent skills and MCP servers.
Safe MCP Agent
A local LLM agent (LangGraph + MCP) with a red-teamed guardrail layer and an automated evaluation harness that benchmarks security and task performance across models.
Hpml Assetopsbench Smart Grid MCP
SmartGridBench: a smart-grid transformer-maintenance benchmark for tool-using LLM agents, built on IBM AssetOpsBench with MCP/direct-call tool surfaces.
Ethogram
Open-source behavioral contract testing for AI agents. Define critical behavior, run the real agent, and catch regressions.
Riposte
A DSL for Pokémon battle policies (Rust compiler, Python runtime, MCP server), built to measure which steering strategy best teaches a coding agent a language it has never seen. G…