- Conduid
- Marketplace
- #vllm
MCP servers tagged vllm
67 live MCP servers tagged "vllm", ranked by trust score. Tags come from package metadata and repository topics, so this list covers servers across every category that work with vllm.
Smg
Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpeed, SGLang, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV ca…
LLM Server Docs
End-to-end documentation to set up your own local & fully private LLM server on Debian. Equipped with chat, web search, RAG, model management, MCP servers, image generation, and T…
MiniAgent
The Cowork Agent for Everything — trainable advertising AI + 14 platform MCP servers + agent skills. Based on minimind (42k stars). Train from zero in 2 hours.
DeepSeek OCR WebUI
🎨 Ready-to-use DeepSeek-OCR Web UI | Modern Interface | 7 Recognition Modes | Batch Processing | Real-time Logging | Fully Responsive
Vllm Playground
A modern web interface for managing and interacting with vLLM servers (www.github.com/vllm-project/vllm). Supports both GPU and CPU modes, with special optimizations for macOS App…
Flama
The production framework for Predictive and Generative AI. Serve any model as an API in one line, with OpenAI/Anthropic/Ollama-compatible endpoints, a built-in chat UI, and native…
Xinfer
Blazing-fast LLM inference in pure Rust. No PyTorch and Python runtime.
Bike4mind
The open-core AI workbench — notebooks, agents, RAG, voice, and images across any model: OpenAI, Anthropic, Google, xAI, or local via Ollama/vLLM. BSL 1.1, auto-converting to Apa…
Global Capacity Orchestrator On AWS
AI/ML and HPC at planetary scale. One API. Every Accelerator. Any Region. MIT-0 licensed
Aiplane
croit AIplane — one plane for all your AI. Self-hosted AI infrastructure connecting applications and users with models, agents, tools and enterprise data: an OpenAI-compatible LLM…
Castor
The Universal 245K Agent Microkernel for Local LLMs.
Deskdrop
Android keyboard with local AI (Ollama, Whisper, MCP) or cloud (Gemini, Groq, OpenAI)
AIMA
AI-Inference-Managed-by-AI: Go binary for managing AI inference on edge devices
Agent Handbook
Illustrated handbook: Agent, MCP, Firecracker, vLLM, SGLang — with diagrams
Guidance For Scalable Model Inference And Agentic AI On Amazon Eks
Comprehensive, scalable ML inference architecture using Amazon EKS, leveraging Graviton processors for cost-effective CPU-based inference and GPU instances for accelerated inferen…
Pxx
Local-first AI coding agent runtime — your models, fail-closed safety, evidence-gated self-improvement
LLM Router
MCP server integration for llm-router
Apogee
Terminal coding agent for local LLMs (llama.cpp, Ollama, vLLM) and any OpenAI-compatible API. OS-sandboxed autonomy, MCP, sessions. Go.
Projectdavid Core
Self-hostable LLM agent runtime
TheYgent
No-code, local-first studio for building and running production ready AI agents. Inference runs on your machine — llama.cpp, MLX, or vLLM — or any OpenAI-compatible API you regist…
AI Runtime Platform
AI Infrastructure OS execution plane: OpenAI-compatible gateway, MCP tool governance, intent proxy, vLLM/KServe/KEDA, OIDC, Redis and telemetry.
Talaria Code
Private AI coding agent for VS Code — agentic edits, inline completions, and chat on your local models (Ollama, vLLM, llama.cpp). Local-first, no cloud.
Omarchy Nebius
Need a bigger GPU? Nebius cloud GPUs from Omarchy: capacity, VM launch, SSH, and Codex + Claude Code tools.
L2MAS
Live2D multi-agent animation prototype with MCP, A2A, provider routing, local AI, ComfyUI/Ollama/vLLM, and FFmpeg.
Open Bdsg Os
Hệ điều hành doanh nghiệp mã nguồn mở: mô hình ngôn ngữ chạy trên máy của chính công ty, nối vào nền tảng nghiệp vụ qua MCP. Nhân giữ danh tính — quyền — hạn mức — nhật ký. Tiếng…
Comfyui Runpod Agentic Nodes
ComfyUI Runpod Agentic workflow nodes for visually designing, planning, launching, monitoring, and cleaning up typed agent workspaces on Runpod.
FlashAgent
The coding agent built for local models. One native binary for your terminal that finds the model your local server has loaded, and tells you whether that model can actually drive…
Localcode
A coding agent that runs on your machine, on any model — and lets a second model check the first. Bedrock, Anthropic, and local LLMs; daemon with TUI, Web UI and desktop clients.
Agent Brain Hub
Shared, brain-inspired memory for AI agents: 13 brain regions with awake/sleep loops, a live visualizer, agents connected via REST/SDK/MCP, governance & audit, and business-value…
Gpu Perf Tune
Agent Skills and an MCP server for GPU performance profiling, benchmarking, optimization, and reporting, with an inference focus.
Haechi
Experimental self-hosted AI context enforcement layer for LLM, MCP, vLLM, Ollama, and agent traffic.
PromptRack
Version prompts. Run them across models. Find what works.
TokLedger
The local inference ledger -> a zero-dependency OpenAI-compatible proxy that prices every request your home GPU serves: tokens, TTFT, tok/s, kWh, local $ and cloud-equivalent cost.
SoAI
An OpenAI and Anthropic-compatible API in front of llama.cpp, Ollama, vLLM and remote providers, with on-demand backends, queuing, failover and load balancing. Also includes a mul…
AI Architecture Vault
first-principles notes and production breakdowns behind @ai.transition episodes
Langchain From Zero
🚀 从零到精通 LangChain - 21章完整中文教程 | 使用 vLLM+Qwen、Langfuse、Playwright | Agent/RAG/LangGraph/MCP 全覆盖 | 100+示例
ApexGraphSwarm
Local-first graph intelligence and multi-agent orchestration workbench with GraphRAG integrations, specialist swarm design, evaluation, and cost-aware delegation.
Langertha
Perl Framework for AI - Langertha - the viking of AI
Jwrede/llmprobe
Synthetic monitoring for LLM inference endpoints. Measure TTFT, latency, throughput, and errors across OpenAI, Anthropic, Google, Azure, Bedrock, and local servers (vLLM, SGLang,…
Autonomous Anomaly Detection And Response Platform
This platform handles the entire lifecycle of an industrial anomaly detection system
K8s AI
🧠 Tenant repository bootstrapped by k8s-infrastructure that contains the manifests for AI related applications
Open Nuechat
Open-Nuechat: The Lightweight, Agentic Alternative to Open WebUI
Nfrx
nfrx is an inference exchange gateway
Agmind MCP
MCP server for measured local-LLM benchmarks from the AGmind claim registry — AMD Strix Halo (Ryzen AI Max+ 395) llama.cpp numbers today, NVIDIA DGX Spark on the bench. search_cla…
Geny Executor
Manifest-driven 21-stage agent pipeline for Python — 5 LLM backends (Anthropic / OpenAI / Google / vLLM / Claude Code CLI), tools, skills, memory, sandboxed CLI runs, MCP. The eng…
Hpml Assetopsbench Smart Grid MCP
SmartGridBench: a smart-grid transformer-maintenance benchmark for tool-using LLM agents, built on IBM AssetOpsBench with MCP/direct-call tool surfaces.
Enterprise AI Systems Masterclass From Local First Laptop To Enterprise Cloud In JavaScript
Production-grade AI systems and autonomous agents for fullstack JavaScript/TypeScript engineers. Build air-gapped, local-first architectures with open-weight models, Zod validatio…
Localagents
MCP server that delegates Claude Code agent work to local models (llama.cpp / vLLM) on your own hardware
Magenticbrain Vllm Aspire
Run microsoft/MagenticBrain (14B) locally on GPU via vLLM (Docker), orchestrated with Aspire + the aichatweb RAG template.
RoseChat
AI agent with async, multithreading and mcp support