- Conduid
- Marketplace
- #ai-evaluation
MCP servers tagged ai-evaluation
30 live MCP servers tagged "ai-evaluation", ranked by trust score. Tags come from package metadata and repository topics, so this list covers servers across every category that work with ai-evaluation.
Headroom
Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for JSON, same answers. Library, proxy, MCP s…
Agentic AI
Agentic AI research papers, benchmarks, frameworks, and tools curated across 24 domains.
Nasde Toolkit
CLI for benchmarks & evals of AI coding agents — on tasks you already understand, using your Claude / Codex / Gemini individual subscriptions or API keys.
Agent Triage
Diagnose your AI agents in production. Extract policies from prompts, evaluate traces, generate diagnostic reports.
Bottrade
SDK, MCP integrations, examples, and verified benchmarks for AI trading agents.
Gutfeel
Usability testing for MCP servers. A decision model that doesn't deliberate gets a bare user mission and walks your tools for real: every path, wrong turn and dead end, mapped and…
Headroom
More human oversight can make an AI agent less safe. Headroom is a human-in-the-loop firewall for coding agents that measures when to trust the human: oversight as resource alloca…
Agentic Frontier Observatory
Bilingual, source-grounded observatory tracing global AI from its intellectual and computational roots to the agentic frontier across models, protocols, runtimes, evaluation, safe…
Agent Reliability Toolkit
Test AI agents repeatedly, measure reliability, classify failures, and catch regressions before production.
Grandjury
Pluralistic human evaluation infrastructure for AI in production
Mdb API Layer
A pytest-based API testing framework for the TMDB REST API, showcasing modern SDET: end-to-end integration tests, Pact contract validation, Dockerized parallel runs, Kubernetes-ba…
Goodbotbadbot
The MCP server behind goodbotbad.bot, where the crowd rules AI transcripts good bot or bad bot.
Harneloop
Build self-evolving AI agent harnesses with portable harness units, artifact-aware testing, trace-backed diagnosis, and evidence-gated promotion.
Awesome Agentic AI
Curated Agentic AI resources: AI agent frameworks, tutorials, courses, projects, MCP tools, research papers, evaluation, security, and production guides.
Agent Skill Forge
Spec-driven AI agent skill generator and verification pipeline for building, testing, repairing, and packaging production-ready agent skills.
Multivon MCP
MCP server exposing multivon-eval + pdfhell as agent-callable tools. Drop into Claude Desktop, Cursor, Cline.
Intent Eval Lab
Vendor-neutral research umbrella for measuring AI plugin, agent, and MCP server quality across CLI runtimes (Claude Code, Gemini CLI, Copilot CLI, Codex CLI).
J Rig Skill Binary Eval
Binary-criteria evaluation harness for Claude skills with planned extension to plugins, agents, and MCP servers. Score every change yes/no across 7 layers — package integrity, tri…
Meva Health AI
Open-source framework for evaluating whether AI agents retrieve and faithfully use medical evidence from synthetic FHIR records.
AI Engineering Learning
An eight-day, agent-first AI engineering curriculum for non-technical learners.
Moses
MO§ES™ — Enterprise AI Operator Evaluations. Marketing site + MCP server. mos2es.org
Software Engineering Rl Lab
Reproducible MCP tool-discovery environments for evaluating coding-agent engineering work.
Vidbyte SDK
Python SDK for building, evaluating, and debugging reliable AI agent harnesses.
Accura
Accura is a multi-agent AI platform designed to generate, evaluate, and refine AI responses until they meet a defined quality threshold. It uses a combination of generator and eva…
Outputproof
Verification infrastructure for AI agent output — assertions, LLM-as-judge scoring, audit logs, and reliability gates before generated work is trusted.
Cclawton
Agentic systems, model evaluation, and tools for creative work
Agentic Compliance Checker
Self-verifying LLM agent for repo/IaC assessment against code-detectable NIST 800-53-inspired controls, with evidence-backed verdicts and evals.
E2H
Evidence-to-Harness toolkit for reproducible AI-agent evaluations, observable evidence, deterministic replay, and verifiable releases.
Aitour27 ILL224 See How Far One Agent Goes In Copilot Studio
No description published.
Learn Agent Harness
No description published.