- Conduid
- Marketplace
- #evals
MCP servers tagged evals
128 live MCP servers tagged "evals", ranked by trust score. Tags come from package metadata and repository topics, so this list covers servers across every category that work with evals.
Arize Phoenix
AI Observability & Evaluation
Raglite
🥤 RAGLite is a Python toolkit for Retrieval-Augmented Generation (RAG) with DuckDB or PostgreSQL
Kiln
Build, Evaluate, and Optimize AI Systems. Includes evals, RAG, agents, fine-tuning, synthetic data generation, dataset management, MCP, and more.
Kiln
Build, Evaluate, and Optimize AI Systems. Includes evals, RAG, agents, fine-tuning, synthetic data generation, dataset management, MCP, and more.
Agentops
Self-hosted LLM operations gateway in one Go binary: OpenAI-compatible router, durable agent tracker, faithfulness evals + drift, traces, MCP server, console
Trulens
Evaluation and Tracking for LLM Experiments and AI Agents
AI System Design Guide
AI system design guide for engineers building production AI systems and evals.
Tracely AI
Trace-native CI/CD for AI agents — production failures become regression tests that block the PR. Auto-detect, cluster, freeze into hermetic cases, replay in CI for $0.
Evals
A Go library and CLI for evaluating Model Context Protocol (MCP) servers using Claude.
Prefect MCP Server
Prefect MCP server
Overmind
The platform for continuously improving AI agents.
Overmind
The platform for continuously improving AI agents.
Waku Agent
Waku Waku! Waku agent is your personal AI agent, on your own laptop, in code you can read in an afternoon — harness + loop + memory + eval
Tracely
Trace-native CI/CD for AI agents — production failures become regression tests that block the PR. Auto-detect, cluster, freeze into hermetic cases, replay in CI for $0.
AI Engineer Notebooks
Hands-on, framework-free Colab notebooks for the AI Engineer / Forward Deployed Engineer (FDE) skill set — model APIs, structured output, tool calling, RAG, evals-as-the-spine, ag…
Semantic MCP
Camada semântica governada exposta a agentes de IA via MCP · o agente escolhe métricas de um vocabulário fechado e nunca escreve SQL · dbt + DuckDB + evals
evals
GitHub Action for evaluating MCP server tool calls using LLM-based scoring
Evals
A Node.js package and GitHub Action for evaluating MCP (Model Context Protocol) tool implementations using LLM-based scoring. This helps ensure your MCP server's tools are working…
Root Signals
MCP for Scorable Evaluation Platform
Mandoline
MCP server that enables LLMs to evaluate themselves
My Pi
Composable Pi coding agent with MCP, LSP, agent chains, prompt presets, and local eval telemetry
My Pi
Composable Pi coding agent with MCP, LSP, agent chains, prompt presets, and local eval telemetry
Agentevals
agentevals is a framework-agnostic evaluations solution based on OpenTelemetry traces
Adlc Team Skills
🐙 ADLC Team Skills — Agentic SDLC for Engineering Teams
Neatroots
neatroots: see, check and replay your AI agent's runs on your machine while you build it. Local-first, by Neatlogs.
Skill Optimizer
Benchmark, evaluate, and optimize skills to ensure reliable performance across all LLMs
mcpvals
Evaluation library for Model Context Protocol servers
Mcpvals
Evaluation library for Model Context Protocol servers
Proofagent Harness
Open-source test harness for AI agents. Stress-test production agents with adversarial multi-turn scenarios in CI
Canopy
An MCP server exposing vehicle-diagnostic / CAN-bus domain logic as agent tools, with a LangGraph orchestration layer and a calibrated human-in-the-loop eval harness. Built above…
Root Signals
improvement capabilities with [Root Signals](https://www.rootsignals.ai/)
Cap Evolve
Optimize any AI agent’s skills, tools/MCP, and prompts against your own evals.
Nasde Toolkit
CLI for benchmarks & evals of AI coding agents — on tasks you already understand, using your Claude / Codex / Gemini individual subscriptions or API keys.
Agentic Product Standard
The canonical standard for building production-grade agentic products — autonomy ladder, composition patterns, the 8-layer harness, eval discipline — plus a Claude Code skill set…
Themoltnet
Accountable authority for autonomous agents
Scenarios
A portable, model-agnostic test suite of declarative YAML scenarios for evaluating AI assistant security against prompt-injection and data-exfiltration attacks, with Python tools…
Skillsmith
An agent with subskills that audits, optimizes, tests, and self-heals agentic skills and prompt-based tools (Claude SKILL.md + Agent SDK / MCP).
Vitest MCP Assert
Vitest integration for mcp-assert: run MCP server assertion YAML files as Vitest tests
Brein
npx wrapper for brein — installs the Python MCP server and runs the setup wizard.
Toolmetry
Measure how well AI agents actually use your MCP server's tools — then rewrite the tool descriptions and prove the improvement with before/after data.
Mcptuner
Audit, observe, and A/B test MCP servers — score tool metadata, log wire traffic, tune descriptions.
MCP
Portable Model Context Protocol tool sources for Crux.
Titration
Let your coding agent fix a prompt until it actually works, and prove it did. A self-hosted MCP server: cross-vendor judges, frozen baselines and memory.
Agentia
面向应用开发的声明式 agent 服务开发框架：装饰器 + DI 声明四类能力，主 agent 编排执行；每次 run 产出结构化结果与可观测调用树（trace、成本、指标），交付可直接上线的服务。
Tessera
Open-source, MCP-native benchmark for whether AI agents reason reliably over fragmented enterprise knowledge — accuracy, provenance, correct refusal.
Awesome Agent Harness
Agent = Model + Harness — the bilingual (EN/中文) curated list on harness engineering for AI PMs and agent product engineers: context, tools/MCP, skills, memory, evals, teardowns. A…
Companmem
the quest for ultimate ai memory
Hermes Rubric
Evidence-first LLM-as-judge scoring for AI artifacts — papers, PRs, prompts, cold emails: synthesizes a rubric, collects quoted-evidence citations, scores only against that eviden…
Agent Capability Benchmark
Outcome-verified, vendor-neutral benchmark for agent capability infrastructure
Modern AI Engineering Path 2026
Production-first roadmap for LLM APIs, RAG, Agents, MCP, Security & Deployment