- Conduid
- Marketplace
- #evals
MCP servers tagged evals
21 live MCP servers tagged "evals", ranked by trust score. Tags come from package metadata and repository topics, so this list covers servers across every category that work with evals.
Arize Phoenix
AI Observability & Evaluation
Raglite
🥤 RAGLite is a Python toolkit for Retrieval-Augmented Generation (RAG) with DuckDB or PostgreSQL
Kiln
Build, Evaluate, and Optimize AI Systems. Includes evals, RAG, agents, fine-tuning, synthetic data generation, dataset management, MCP, and more.
Agentops
Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including CrewAI, Agno, OpenAI Agents SDK, Langchain,…
Trulens
Evaluation and Tracking for LLM Experiments and AI Agents
AI System Design Guide
AI system design guide for engineers building production AI systems and evals.
Evals
A Go library and CLI for evaluating Model Context Protocol (MCP) servers using Claude.
Prefect MCP Server
Prefect MCP server
Waku Agent
Waku Waku! Waku agent is your personal AI agent, on your own laptop, in code you can read in an afternoon — harness + loop + memory + eval
Tracely
Trace-native CI/CD for AI agents — production failures become regression tests that block the PR. Auto-detect, cluster, freeze into hermetic cases, replay in CI for $0.
evals
GitHub Action for evaluating MCP server tool calls using LLM-based scoring
Root Signals
MCP for Scorable Evaluation Platform
Mandoline
MCP server that enables LLMs to evaluate themselves
mcpvals
Evaluation library for Model Context Protocol servers
Root Signals
improvement capabilities with [Root Signals](https://www.rootsignals.ai/)
Cap Evolve
Optimize any AI agent’s skills, tools/MCP, and prompts against your own evals.
Vitest MCP Assert
Vitest integration for mcp-assert: run MCP server assertion YAML files as Vitest tests
Brein
npx wrapper for brein — installs the Python MCP server and runs the setup wizard.
Jig
A testing workbench for MCP (Model Context Protocol) servers — inspect, call, budget, and bench MCP servers from the command line.
Toolmetry
Measure how well AI agents actually use your MCP server's tools — then rewrite the tool descriptions and prove the improvement with before/after data.
Trip Loom Monorepo
AI-powered travel assistant application + MCP Server for planning trips, booking flights & hotels, and building itineraries.