- Conduid
- Marketplace
- #llmops
MCP servers tagged llmops
43 live MCP servers tagged "llmops", ranked by trust score. Tags come from package metadata and repository topics, so this list covers servers across every category that work with llmops.
Gateway
A blazing fast AI Gateway with integrated guardrails. Route to 200+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.
Openllmetry
Open-source observability for your GenAI or LLM application, based on OpenTelemetry
duaraghav8/MCPJungle
Self-hosted MCP Gateway for AI agents
Better Agents
Standards for building agents, better
openinference-instrumentation
OpenTelemetry Instrumentation for AI Observability
Awesome Llmops
An awesome & curated list of best LLMOps tools for developers
Nexus
Govern & Secure your AI
Synalinks
From idea to production in just few lines: Graph-Based Programmable Neuro-Symbolic LM Framework - a production-first LM framework built with decade old Deep Learning best practices
LLM Agents Ecosystem Handbook
One-stop handbook for building, deploying, and understanding LLM agents with 60+ skeletons, tutorials, ecosystem guides, and evaluation tools.
Station
Station is our open-source runtime that lets teams deploy agents on their own infrastructure with full control.
zenml-io/mcp-zenml
ZenML 🙏: One AI Platform from Pipelines to Agents. https://zenml.io.
Hoot
MCP Testing Tool — Like Postman, but for the Model Context Protocol.
Google Cloud MCP
🤖 A Model Context Protocol (MCP) server for Google Cloud (GCP)
Turbular
A MCP server allowing LLM agents to easily connect and retrieve data from any database
Opik
Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.
Semantica
Semantica 🧠 — A framework for building semantic layers, context graphs, and decision intelligence systems with explainability and provenance.
Openagent
What if OpenAI Deep Research and Dify were one platform? OpenAgent — harness architecture for rapidly building vertical AI agents, with deep reasoning loops, visual workflows, RAG…
Trulens
Evaluation and Tracking for LLM Experiments and AI Agents
Intelligent Audit System
Enterprise audit agent workspace with Agentic RAG, governed tool use, evaluation harness, memory, and human-review delivery workflows.
Openinference Instrumentation
OpenInference instrumentation for MCP
Sample Genai On Eks Starter Kit
A comprehensive toolkit for deploying production-ready Generative AI infrastructure on Amazon EKS. Includes pre-configured components for: 🚀 AI Gateway (LiteLLM) 🤖 LLM Serving (v…
duaraghav8/MCPJungle
hosted MCP Server registry for enterprise AI Agents
Agentacct
See what your coding agents did and what it cost. Breaks each task down into work steps — tools used, files changed, tests run, time and tokens spent. Local-first dashboard for Cl…
Waku Agent
Waku Waku! Waku agent is your personal AI agent, on your own laptop, in code you can read in an afternoon — harness + loop + memory + eval
Tracely
Trace-native CI/CD for AI agents — production failures become regression tests that block the PR. Auto-detect, cluster, freeze into hermetic cases, replay in CI for $0.
EnterpriseAgentFramework
Enterprise AI Capability Platform for Java/Spring Boot. Register business APIs as governed AI capabilities, compose Agents with GraphSpec, Runtime, MCP/A2A/Gateway, RunOps and Tra…
Sidekick
Local coding-agent orchestrator — DAG of auto-approved, git-worktree-isolated sub-sessions across LLM providers (Claude/Kimi/Grok/DeepSeek/local). AGPL-3.0.
Redevops Rag
Hybrid RAG (DuckDB vector + BM25 + RRF + recency/keyword priors + optional cross-encoder rerank) as an installable library + CLI.
Host
MCP client manager: stdio + SSE transports, exp-backoff reconnect, server registry, built on @modelcontextprotocol/sdk
Model Compose
Docker Compose for AI workflows. Define AI agents, RAG pipelines, MCP servers, and multi-LLM apps in a single YAML file — a lightweight alternative to LangChain.
Tma1
Local-first observability your agent reads back. TMA1 records every LLM call, then routes what it sees into the agent's next turn via hooks and MCP.
Agents Shipgate
The deterministic merge gate for AI-generated agent capability changes — a local-first, static Tool-Use Readiness review for MCP, OpenAPI, and SDK tool surfaces. Open-source CLI +…
Llmtrim
Local proxy that compresses your LLM API requests so you pay less, with no change to the answers. Trims wasted tokens from prompts, history, tool output, and code before they're s…
Context Runtime
Context Runtime — a database query planner for LLM context. Decides what a model sees before it answers; plans it, runs it through reused substrate, and learns from the outcome.
Aura
A production-ready framework for composing AI agents from declarative TOML configuration, with MCP tool integration, RAG pipelines, and an OpenAI-compatible web API.
Nora
The self-hosted, runtime-neutral operations platform for Hermes and OpenClaw fleets.
Awesome AI Gateway
⚡ Awesome AI Gateway — curated comparison of 100+ AI gateways & LLM proxies (LiteLLM, OpenRouter, Portkey, Kong, Higress, new-api, Bifrost) by cost, security, compliance & self-ho…
Awesome X Ops
A curated map of modern X-Ops: AI Ops, LLM/Agent Observability, Platform Engineering, GitOps, DataOps, FinOps, DevSecOps, and production-grade open-source operations tooling.面向现代…
LLM Router
MCP server integration for llm-router
LLM Cost Telemetry
MCP server exposing LLM cost telemetry as Model Context Protocol tools
Jwrede/llmprobe
Synthetic monitoring for LLM inference endpoints. Measure TTFT, latency, throughput, and errors across OpenAI, Anthropic, Google, Azure, Bedrock, and local servers (vLLM, SGLang,…
Acornops
Open-source, self-hosted AI-assisted operations for Kubernetes and Linux. Start here for source, architecture, deployment, and contributions.
AgentWire
OpenTelemetry + Wireshark + Cloudflare for AI Agents. Monitor, inspect, secure, replay, and optimize all traffic between Users, AI Agents, LLMs, and MCP Servers.