📦
Simple Fastmcp Deepeval Test
No description available
0 installs
Trust: 30 — Low
Devtools
Ask AI about Simple Fastmcp Deepeval Test
Powered by Claude · Grounded in docs
I know everything about Simple Fastmcp Deepeval Test. Ask me about installation, configuration, usage, or troubleshooting.
0/500
Loading tools...
Reviews
Documentation
FastMCP Server
A basic MCP server built with FastMCP that provides a workflow tool.
Setup
pip install -e .
Run
python server.py
Or with the MCP CLI:
mcp run server.py
Tools
get_workflow: Returns instructions for the AI to fetch https://www.rotios.dev and read the title.
Testing
The test suite in tests/test_claude_workflow.py validates the integration between the FastMCP server, Claude Code CLI, and DeepEval. These tests check tool chaining, output correctness, and haiku structure.
How to Run Tests
pytest tests/test_claude_workflow.py
Ensure you have the following installed and available in your environment:
Test Descriptions
- test_rotios_site_title: Uses DeepEval's GEval metric to check that the Claude Code CLI returns the correct site title ("Jose Rivas-Garcia") for rotios.dev.
- test_rotios_site_title_exact: Asserts that the output from Claude Code CLI contains the exact string "Jose Rivas-Garcia".
- test_haiku_tool_chains_correctly: Verifies that the haiku tool chains correctly to retrieve the real name before generating a haiku, and that the output includes "Jose Rivas-Garcia" or "Jose".
- test_ascii_art_tool_chains_correctly: Checks that the ASCII art tool chains correctly and the output references the site owner ("Jose", "Rivas", "Garcia", or "rotios.dev").
- test_haiku_has_valid_structure: Uses DeepEval's GEval metric to ensure the generated haiku follows the 5-7-5 syllable structure (three lines, with 5, 7, and 5 syllables respectively).
All tests use a custom DeepEval model that wraps the Claude Code CLI for evaluation, so no separate API key is required.
