MCP servers tagged model-serving

3 live MCP servers tagged "model-serving", ranked by trust score. Tags come from package metadata and repository topics, so this list covers servers across every category that work with model-serving.

live servers

avg trust

Flama

The production framework for Predictive and Generative AI. Serve any model as an API in one line, with OpenAI/Anthropic/Ollama-compatible endpoints, a built-in chat UI, and native…

HARTOS

An AI-native OS. Models run on your own hardware, nodes federate peer-to-peer with no broker, and the API is OpenAI-compatible. Boots, has its own Wayland compositor, and runs on…

Triton MCP

NVIDIA Triton Inference Server control plane — model repository manipulation, VRAM monitoring, and inference over gRPC via FastMCP 3.2