1. Conduid
  2. Analytics
  3. Fastevals
MCP server · Analytics

Fastevals

by · github.com/semenovdv/fastevals

Give your AI agents an evaluation tool - provider-agnostic LLM eval runner with an MCP server for Claude, structured output validation, datasets, evaluators and honest cost metrics

Unclaimed benchmarkevaluationlitellmllmmcpmcp-serveropenaipython
InstallView source
34Low

Scored a month ago · breakdown

About Fastevals

Fastevals is an MCP server published by semenovdv in the Analytics category: give your AI agents an evaluation tool - provider-agnostic LLM eval runner with an MCP server for Claude, structured output validation, datasets, evaluators and honest cost metrics.

Recent commit activity is the strongest signal that reported issues will get attention.

Install

From source
git clone https://github.com/semenovdv/fastevals

This server has no ConduID identity, so agent calls to it are not receipted. Pin the version you install and review the source before granting it credentials.

Tools (4)

get_runDeep-dive into one saved run: pass rate, errors, total cost

Parameters not published.

list_modelsRegistry inspector: models, reasoning efforts, pricing

Parameters not published.

list_runsRecent evaluations, newest first — history across sessions

Parameters not published.

run_evaluationRun a prompt, dataset file, or **inline cases** across providers; returns JSON summary + report paths. `output_limit` keeps long answers out of agent context

Parameters not published.

Ask AI

✦

Ask AI about Fastevals

Powered by Claude · Grounded in docs

I know everything about Fastevals. Ask me about installation, configuration, usage, or troubleshooting.

Security checks

6 checks have not been run yet.

Questions

About Fastevals

How do I install Fastevals?

No package has been published for this server, so install it from source: clone the repository and follow its README.

Is Fastevals safe to use with an AI agent?

Its trust score is 34 out of 100 (low). Conduid hasn't run static security checks on this repository yet, so review the source yourself before granting it credentials. It has no ConduID identity yet, so agent calls to it are not receipted.

Is Fastevals still maintained?

Yes — the last commit was 2 months ago. The repository has 0 stars and 0 forks.