About io.github.tjacquesson/llmtest-mcp
io.github.tjacquesson/llmtest-mcp is an MCP server in the Healthcare category: benchmark AI models on real prompts. Find cheaper, faster alternatives across 340+ models.
Install
claude mcp add io-github-tjacquesson-llmtest-mcp -- npx -y llmtest-mcpnpx -y llmtest-mcpThis server has no ConduID identity, so agent calls to it are not receipted. Pin the version you install and review the source before granting it credentials.
Tools (15)
disable_autopilotTurn off autopilot (existing optimizations stay active)
Parameters not published.
enable_autopilotTurn on weekly auto-optimization with safety gates + drift-based auto-revert
Parameters not published.
get_accountCheck credit balance and usage
Parameters not published.
get_autopilot_statusCheck whether autopilot is on and whether the account is eligible
Parameters not published.
get_suggestionsGet pending model-switch recommendations
Parameters not published.
list_active_optimizationsList auto-accepted optimizations still inside their 24h revert window
Parameters not published.
list_flowsList all AI flows with cost and latency stats
Parameters not published.
list_new_modelsShow new and trending models
Parameters not published.
list_samplesShow stored test samples per flow
Parameters not published.
optimize_promptRewrite a flow's prompt and find a cheaper model that still works
Parameters not published.
Show all 15 tools
revert_optimizationRoll an auto-accepted optimization back to the previous prompt
Parameters not published.
run_benchmarkBenchmark a flow against challenger models
Parameters not published.
seed_samplesAdd test prompts for pre-launch benchmarking
Parameters not published.
statusShow proxy status and activity summary
Parameters not published.
update_suggestionAccept or dismiss a suggestion
Parameters not published.
Ask AI
Ask AI about io.github.tjacquesson/llmtest-mcp
Powered by Claude · Grounded in docs
Security checks
6 checks have not been run yet.