scan_your_ai_toolkit
Open-source AI governance toolkit. MCP servers & CLIs for scanning, auditing, and managing your AI environment
Ask AI about scan_your_ai_toolkit
Powered by Claude Β· Grounded in docs
I know everything about scan_your_ai_toolkit. Ask me about installation, configuration, usage, or troubleshooting.
0/500
Reviews
Documentation
π‘οΈ Scan Your AI Toolkit
Open-source AI governance tools. Each works standalone as an MCP server or CLI β together they form a governance mesh.
Built by Maiife β Enterprise AI Control Plane.
Tools
| Package | Description | Published |
|---|---|---|
@maiife-ai-pub/shared | Shared types and formatters used by all toolkit packages | β |
@maiife-ai-pub/probe | AI environment scanner β discover IDE extensions, MCP servers, agent frameworks, API keys, local models | β |
@maiife-ai-pub/mcp-audit | MCP server security scanner β score configs on permissions, data sensitivity, blast radius | β |
@maiife-ai-pub/ai-stack | "What's Your AI Stack?" β shareable profile card of your AI toolkit | β |
@maiife-ai-pub/mcp-doctor | MCP health check & auto-fixer β brew doctor for your MCP setup | β |
@maiife-ai-pub/ai-journal | Personal AI usage diary β track how you use AI, get reflective insights | β |
@maiife-ai-pub/context-sync | Cross-tool AI memory sync β one context.json, synced to Cursor, Claude, MCP | β |
@maiife-ai-pub/prompt-score | Prompt quality analyzer β score, improve, and lint your AI prompts | β |
@maiife-ai-pub/eval | LLM-as-judge evaluation engine β score agent outputs with structured rubrics | β |
@maiife-ai-pub/trace | Agent workflow tracer β trace, view, and analyze execution spans | β |
@maiife-ai-pub/cost | AI spend calculator + optimizer β unified cost report across vendors | β |
@maiife-ai-pub/prompt-craft | Gamified prompt coach β levels, streaks, badges for prompt improvement | β |
@maiife-ai-pub/sub-audit | Personal AI subscription auditor β find waste in your AI spending | β |
@maiife-ai-pub/model-match | Personal model recommender β find the best model for YOUR tasks | β |
@maiife-ai-pub/weekly-ai-report | AI week in review β Spotify Wrapped for your AI usage, weekly | β |
Quick Start
# Scan your AI environment
npx @maiife-ai-pub/probe scan
# Audit your MCP server security
npx @maiife-ai-pub/mcp-audit scan
# Generate your AI Stack profile card
npx @maiife-ai-pub/ai-stack --format svg --output my-stack.svg
# Health check your MCP servers
npx @maiife-ai-pub/mcp-doctor check
# Log an AI interaction
npx @maiife-ai-pub/ai-journal log --tool claude --task coding --duration 30
# Sync AI context across tools
npx @maiife-ai-pub/context-sync push
# Score your AI prompts
npx @maiife-ai-pub/prompt-score analyze --input prompt.txt
# Evaluate agent outputs with rubrics
npx @maiife-ai-pub/eval score --rubric code-review --input review.txt
# Trace agent workflows
npx @maiife-ai-pub/trace list --days 7
# Track AI spend across vendors
npx @maiife-ai-pub/cost report --period last-30d
# Gamified prompt coaching
npx @maiife-ai-pub/prompt-craft score --input prompt.txt
# Audit AI subscriptions for waste
npx @maiife-ai-pub/sub-audit
# Find the best model for your tasks
npx @maiife-ai-pub/model-match recommend --task coding
# Generate your AI week in review
npx @maiife-ai-pub/weekly-ai-report generate
Use as MCP Server
Every tool with an MCP server can be added to Claude Desktop, Cursor, or any MCP-compatible client. Each exposes tools over stdio transport.
~/Library/Application Support/Claude/claude_desktop_config.json (macOS) or %APPDATA%\Claude\claude_desktop_config.json (Windows):
{
"mcpServers": {
"maiife-probe": {
"command": "npx",
"args": ["@maiife-ai-pub/probe", "mcp"]
},
"maiife-mcp-audit": {
"command": "npx",
"args": ["@maiife-ai-pub/mcp-audit", "mcp"]
},
"maiife-mcp-doctor": {
"command": "npx",
"args": ["@maiife-ai-pub/mcp-doctor", "mcp"]
},
"maiife-eval": {
"command": "npx",
"args": ["@maiife-ai-pub/eval", "mcp"]
},
"maiife-prompt-score": {
"command": "npx",
"args": ["@maiife-ai-pub/prompt-score", "mcp"]
},
"maiife-prompt-craft": {
"command": "npx",
"args": ["@maiife-ai-pub/prompt-craft", "mcp"]
},
"maiife-cost": {
"command": "npx",
"args": ["@maiife-ai-pub/cost", "mcp"]
},
"maiife-model-match": {
"command": "npx",
"args": ["@maiife-ai-pub/model-match", "mcp"]
},
"maiife-ai-stack": {
"command": "npx",
"args": ["@maiife-ai-pub/ai-stack", "mcp"]
},
"maiife-context-sync": {
"command": "npx",
"args": ["@maiife-ai-pub/context-sync", "mcp"]
},
"maiife-sub-audit": {
"command": "npx",
"args": ["@maiife-ai-pub/sub-audit", "mcp"]
},
"maiife-trace": {
"command": "npx",
"args": ["@maiife-ai-pub/trace", "mcp"]
}
}
}
Pick the tools you need β you don't have to add all of them. Once configured, Claude can call tools like probe_scan, mcp_audit_scan, eval_score, prompt_score_analyze, cost_report, and more directly from chat.
Run with Docker
Each MCP server is published as a Docker image on GHCR. Useful for sandboxed environments or Glama integration.
# Pull and run any server
docker run -i ghcr.io/sakthivelchan89/maiife-probe
docker run -i ghcr.io/sakthivelchan89/maiife-mcp-audit
docker run -i ghcr.io/sakthivelchan89/maiife-eval
# ... same pattern for all 12 packages
# Or build from source
docker build -f packages/probe/Dockerfile -t maiife-probe .
docker run -i maiife-probe
Docker images use stdio transport (no ports exposed). Pass -i for interactive stdin/stdout communication with MCP clients.
Quality & Compliance
This toolkit aims to meet MCP Tier 1 quality standards (per MCP SEP-1730). Here's what that means:
| Dimension | Status |
|---|---|
| License | Apache 2.0 β canonical SPDX, OSI-approved |
| Transport | stdio only (no network exposure) |
| CI/CD | GitHub Actions: lint + type-check + tests on Node 18, 20, 22 |
| Test coverage | vitest + @vitest/coverage-v8, reported per-package |
| MCP conformance | Protocol compliance suite for all 12 MCP servers |
| Security scanning | CodeQL (weekly + on PR), Dependabot (weekly) |
| Vulnerability response | 48h CRITICAL / 7d HIGH (see DEPENDENCY_POLICY.md) |
| Issue triage SLA | 2 business days (see CONTRIBUTING.md) |
| Versioning | SemVer, lockstep across packages, CHANGELOG.md |
| Supply chain | pnpm-lock.yaml committed, --frozen-lockfile in CI |
| Container security | Non-root user, no exposed ports, GHCR-signed |
Conformance test suite
Every MCP server in this repo is validated against the MCP protocol contract:
- β stdio transport invariant (no non-JSON output on stdout)
- β
initializehandshake responds with validserverInfo+ capabilities - β
tools/listreturns the documented tool set - β
All tool
inputSchemafields are valid JSON Schema objects - β Unknown tool calls return structured errors (not crashes)
Run the suite:
pnpm test:conformance # all packages
cd packages/probe && pnpm test:conformance # single package
Documentation
- SECURITY.md β vulnerability reporting policy
- CONTRIBUTING.md β issue/PR guidelines and SLAs
- CHANGELOG.md β version history (Keep a Changelog format)
- DEPENDENCY_POLICY.md β dependency selection criteria & patch SLAs
Contributing
Contributions are welcome! Read CONTRIBUTING.md for the full guide. Quick version:
- Fork the repo on GitHub
- Create a branch:
git checkout -b feat/my-improvement - Make your changes β each package lives in
packages/<name>/ - Run tests:
pnpm test && pnpm test:conformance - Open a PR against
mainβ describe what you changed and why
Please follow the existing code style (TypeScript, ESM, Vitest for tests). Each package should work as both a CLI and an MCP server where applicable.
License
Apache 2.0 β free to use, modify, and distribute.
Part of the Maiife platform β Enterprise AI Control Plane.
