- Conduid
- Marketplace
- #model-serving
MCP servers tagged model-serving
8 live MCP servers tagged "model-serving", ranked by trust score. Tags come from package metadata and repository topics, so this list covers servers across every category that work with model-serving.
Flyte
Type-safe, distributed orchestration of agents, ML pipelines, and real-time inference on your k8s — in pure Python with async/await, also other languages (rust, go and ts)
Flama
The production framework for Predictive and Generative AI. Serve any model as an API in one line, with OpenAI/Anthropic/Ollama-compatible endpoints, a built-in chat UI, and native…
HARTOS
An AI-native OS. Models run on your own hardware, nodes federate peer-to-peer with no broker, and the API is OpenAI-compatible. Boots, has its own Wayland compositor, and runs on…
AI Runtime Platform
AI Infrastructure OS execution plane: OpenAI-compatible gateway, MCP tool governance, intent proxy, vLLM/KServe/KEDA, OIDC, Redis and telemetry.
FrontierSignal
An AI engineering radar for frontier research, tools, and systems - filtering, ranking, summarizing, and delivering the updates that matter every day.
Flama Examples
A set of curated examples showcasing Flama's capabilities
LLM MCP Fastapi
FastAPI + MCP server for LLM inference — chat API with tool-calling, streaming responses, and model-context-protocol support.
Local Model Gateway
Lightweight local AI workstation management for local agents and LLM apps.