MCP servers tagged llm-serving

7 live MCP servers tagged "llm-serving", ranked by trust score. Tags come from package metadata and repository topics, so this list covers servers across every category that work with llm-serving.

live servers

avg trust

Flama

The production framework for Predictive and Generative AI. Serve any model as an API in one line, with OpenAI/Anthropic/Ollama-compatible endpoints, a built-in chat UI, and native…

AIMA

AI-Inference-Managed-by-AI: Go binary for managing AI inference on edge devices

Fak

Agentic Runtime

Flama Examples

A set of curated examples showcasing Flama's capabilities

Molla

Local inference server in pure Mojo. Speaks OpenAI, Anthropic, and MCP. Models are OCI artifacts. Same source runs on CPU, NVIDIA, AMD, and Apple GPUs. Apache-2.0 all the way down.

Sample To Make LLM Service

Sample code to make llm service

AI Infra Lab Cn

面向中文开发者的 AI Infra 研究、情报与可运行工程实践站。