Tag

MCP servers tagged vllm

9 live MCP servers tagged "vllm", ranked by trust score. Tags come from package metadata and repository topics, so this list covers servers across every category that work with vllm.

live servers

avg trust

LLM Server Docs

End-to-end documentation to set up your own local & fully private LLM server on Debian. Equipped with chat, web search, RAG, model management, MCP servers, image generation, and T…

DeepSeek OCR WebUI

Vllm Playground

A modern web interface for managing and interacting with vLLM servers (www.github.com/vllm-project/vllm). Supports both GPU and CPU modes, with special optimizations for macOS App…

Smg

Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpeed, SGLang, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV ca…

Flama

The production framework for Predictive and Generative AI. Serve any model as an API in one line, with OpenAI/Anthropic/Ollama-compatible endpoints, a built-in chat UI, and native…

Deskdrop

Android keyboard with local AI (Ollama, Whisper, MCP) or cloud (Gemini, Groq, OpenAI)

LLM Router

MCP server integration for llm-router

Langertha

Perl Framework for AI - Langertha - the viking of AI

Jwrede/llmprobe

Synthetic monitoring for LLM inference endpoints. Measure TTFT, latency, throughput, and errors across OpenAI, Anthropic, Google, Azure, Bedrock, and local servers (vLLM, SGLang,…