About Evalmonkey
Evalmonkey is an MCP server in the Science category: cLI for agent builders to benchmark & chaos test your AI Agents. Text, Voice, Code supported.
Install
git clone https://github.com/Corbell-AI/evalmonkeyThis server has no ConduID identity, so agent calls to it are not receipted. Pin the version you install and review the source before granting it credentials.
Tools (6)
generate_improvement_evalsRun a benchmark, capture failures, synthesise targeted test cases, save to `output/`
Parameters not published.
get_benchmark_historyReturn chronological score history for a scenario
Parameters not published.
get_eval_assetsRead saved `traces.json` / `evals.json` / `improvement_prompt.md` directly into context
Parameters not published.
run_benchmarkRun a standard benchmark against any HTTP agent URL
Parameters not published.
run_chaosRun a benchmark with a specific chaos profile injected
Parameters not published.
run_full_pipeline**One-shot**: baseline + chaos + eval generation + optional Langfuse export
Parameters not published.
Ask AI
Ask AI about Evalmonkey
Powered by Claude · Grounded in docs
Security checks
6 checks have not been run yet.