1. Conduid
  2. Security
  3. io.github.cyanheads/evals-mcp-server
MCP server · Security

io.github.cyanheads/evals-mcp-server

Author verifiable eval records through a draft→review→revise→submit loop with enforced graders.

Unclaimed security
37Low

Scored 3 months ago · breakdown

About io.github.cyanheads/evals-mcp-server

io.github.cyanheads/evals-mcp-server is an MCP server in the Security category: author verifiable eval records through a draft→review→revise→submit loop with enforced graders.

Install

Claude Code
claude mcp add io-github-cyanheads-evals-mcp-server -- npx -y @cyanheads/evals-mcp-server
npx
npx -y @cyanheads/evals-mcp-server

This server has no ConduID identity, so agent calls to it are not receipted. Pin the version you install and review the source before granting it credentials.

Tools (9)

evals_create_draftCreate a draft eval record carrying its own grader; returns the parsed record, a review protocol, and a verification subagent prompt.

Parameters not published.

evals_describe_schemaReturn the required and optional fields plus grader options for a task type. Call before drafting.

Parameters not published.

evals_discard_draftDelete a draft record by id. Draft-only.

Parameters not published.

evals_export_recordsCompile submitted records to JSONL, CSV, Inspect AI, or lm-evaluation-harness and write the artifact under `exports/`.

Parameters not published.

evals_get_recordRead a draft or submitted record by id; the id is stable across submit.

Parameters not published.

evals_list_recordsBrowse and filter records by status, domain, task type, or tag. Returns a compact summary per record.

Parameters not published.

evals_revise_draftApply a surgical `set` / `append` / `unset` patch to a draft by dotted path; re-runs the self-consistency check.

Parameters not published.

evals_run_checkRun a grader spec against candidate answers and get PASS/REJECT per candidate, decoupled from any saved record.

Parameters not published.

evals_submit_draftFinalize a draft through the committability gate, then freeze it.

Parameters not published.

Ask AI

✦

Ask AI about io.github.cyanheads/evals-mcp-server

Powered by Claude · Grounded in docs

I know everything about io.github.cyanheads/evals-mcp-server. Ask me about installation, configuration, usage, or troubleshooting.

Security checks

6 checks have not been run yet.

Questions

About io.github.cyanheads/evals-mcp-server

How do I install io.github.cyanheads/evals-mcp-server?

Run claude mcp add io-github-cyanheads-evals-mcp-server -- npx -y @cyanheads/evals-mcp-server, then add the server to your MCP client's configuration.

Is io.github.cyanheads/evals-mcp-server safe to use with an AI agent?

Its trust score is 37 out of 100 (low). Conduid hasn't run static security checks on this repository yet, so review the source yourself before granting it credentials. It has no ConduID identity yet, so agent calls to it are not receipted.

Is io.github.cyanheads/evals-mcp-server still maintained?

Conduid hasn't recorded a commit date for this repository yet. Check the repository directly for recent activity.