- Conduid
- Marketplace
- #llmops
MCP servers tagged llmops
198 live MCP servers tagged "llmops", ranked by trust score. Tags come from package metadata and repository topics, so this list covers servers across every category that work with llmops.
Gateway
A blazing fast AI Gateway with integrated guardrails. Route to 200+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.
Openllmetry
Open-source observability for your GenAI or LLM application, based on OpenTelemetry
duaraghav8/MCPJungle
One place to manage & connect to all your MCP servers
AI Gateway
Labs to explore AI Models, MCP servers, and Agents with the AI Gateway powered by Azure API Management and Microsoft Foundry π
Better Agents
Standards for building agents, better
openinference-instrumentation
OpenTelemetry Instrumentation for AI Observability
Awesome Llmops
An awesome & curated list of best LLMOps tools for developers
Synalinks
Keras based framework for neuro-symbolic LM systems
Nexus
Govern & Secure your AI
LLM Agents Ecosystem Handbook
One-stop handbook for building, deploying, and understanding LLM agents with 60+ skeletons, tutorials, ecosystem guides, and evaluation tools.
zenml-io/mcp-zenml
MCP server to connect an MCP client (Cursor, Claude Desktop etc) with your ZenML MLOps and LLMOps pipelines
Hoot
MCP Testing Tool β Like Postman, but for the Model Context Protocol.
Turbular
A MCP server allowing LLM agents to easily connect and retrieve data from any database
Awesome AI Engineering
π A curated collection of AI engineering resources, roadmaps, tools, and projects covering LLMs, RAG, AI Agents, MCP, fine-tuning, evaluations, and production AI systems.
Agentops
Self-hosted LLM operations gateway in one Go binary: OpenAI-compatible router, durable agent tracker, faithfulness evals + drift, traces, MCP server, console
Opik
Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.
Semantica
Semantica π§ β A framework for building semantic layers, context graphs, and decision intelligence systems with explainability and provenance.
Trulens
Evaluation and Tracking for LLM Experiments and AI Agents
Intelligent Audit System
Enterprise audit agent workspace with Agentic RAG, governed tool use, evaluation harness, memory, and human-review delivery workflows.
Tracely AI
Trace-native CI/CD for AI agents β production failures become regression tests that block the PR. Auto-detect, cluster, freeze into hermetic cases, replay in CI for $0.
Openinference Instrumentation
OpenInference instrumentation for MCP
Sample Genai On Eks Starter Kit
A comprehensive toolkit for deploying production-ready Generative AI infrastructure on Amazon EKS. Includes pre-configured components for: π AI Gateway (LiteLLM) π€ LLM Serving (vβ¦
Overmind
The platform for continuously improving AI agents.
duaraghav8/MCPJungle
hosted MCP Server registry for enterprise AI Agents
Agentacct
See what your coding agents did and what it cost. Breaks each task down into work steps β tools used, files changed, tests run, time and tokens spent. Local-first dashboard for Clβ¦
Waku Agent
Waku Waku! Waku agent is your personal AI agent, on your own laptop, in code you can read in an afternoon β harness + loop + memory + eval
Tracely
Trace-native CI/CD for AI agents β production failures become regression tests that block the PR. Auto-detect, cluster, freeze into hermetic cases, replay in CI for $0.
AI Engineer Notebooks
Hands-on, framework-free Colab notebooks for the AI Engineer / Forward Deployed Engineer (FDE) skill set β model APIs, structured output, tool calling, RAG, evals-as-the-spine, agβ¦
ZizkaDB
Audit trail database for AI agents. Tamper-evident, checksum-backed decision logs with session replay and time-travel debugging to support EU AI Act Article 12 record-keeping. Driβ¦
EnterpriseAgentFramework
Enterprise AI Capability Platform for Java/Spring Boot. Register business APIs as governed AI capabilities, compose Agents with GraphSpec, Runtime, MCP/A2A/Gateway, RunOps and Traβ¦
Sidekick
Local coding-agent orchestrator β DAG of auto-approved, git-worktree-isolated sub-sessions across LLM providers (Claude/Kimi/Grok/DeepSeek/local). AGPL-3.0.
Redevops Rag
Hybrid RAG (DuckDB vector + BM25 + RRF + recency/keyword priors + optional cross-encoder rerank) as an installable library + CLI.
Juror
Cheaper and better Greptile alternative runs on your own github actions.
Model Compose
Docker Compose for AI workflows. Define AI agents, RAG pipelines, MCP servers, and multi-LLM apps in a single YAML file β a lightweight alternative to LangChain.
Tma1
Local-first observability your agent reads back. TMA1 records every LLM call, then routes what it sees into the agent's next turn via hooks and MCP.
Agents Shipgate
The deterministic merge gate for AI-generated agent capability changes β a local-first, static Tool-Use Readiness review for MCP, OpenAPI, and SDK tool surfaces. Open-source CLI +β¦
Llmtrim
Local proxy that compresses your LLM API requests so you pay less, with no change to the answers. Trims wasted tokens from prompts, history, tool output, and code before they're sβ¦
Context Runtime
Context Runtime β a database query planner for LLM context. Decides what a model sees before it answers; plans it, runs it through reused substrate, and learns from the outcome.
Aisix Archived
An open source, Native AI Gateway and LLM proxy built in Rust
AI Engineering Playbook
A zero-to-100 learning path for applied AI engineering β RAG, embeddings, vector search, agents, MCP, and the production engineering around them. 56 pages, built as a searchable sβ¦
Byok Relay
Bring your own key (BYOK) relay to enable lightweight frontend-only apps to use LLMs using the user's API keys without hitting CORS.
Awesome Agent Observability
Curated list of tools, standards, and platforms for LLM and AI-agent observability: OpenTelemetry GenAI conventions, tracing, evals, guardrails, gateways, and MCP tooling.
AI For DevOps
A 21-day hands-on journey to mastering AI for DevOps β covering LLMs, GenAI, CI/CD, Kubernetes, cloud, automation, and AI-powered DevOps projects.
Mini Ork
Prove an AI-written fix actually fixes the bug. mini-ork certify reproduces the bug against your repo's own code, attacks the patch with generated invariants in a Docker sandbox,β¦
Proofagent Harness
Open-source test harness for AI agents. Stress-test production agents with adversarial multi-turn scenarios in CI
Etchplan
Compile an AI agent's repeated workflows into deterministic, auditable routines that replay for free, with a fallback to the agent.
Praxos
MCP-powered memory, policy, and experience layer for safer AI agents.
Nora
The self-hosted, runtime-neutral operations platform for Hermes and OpenClaw fleets.
Awesome AI Gateway
β‘ Awesome AI Gateway β curated comparison of 100+ AI gateways & LLM proxies (LiteLLM, OpenRouter, Portkey, Kong, Higress, new-api, Bifrost) by cost, security, compliance & self-hoβ¦
Awesome X Ops
A curated map of modern X-Ops: AI Ops, LLM/Agent Observability, Platform Engineering, GitOps, DataOps, FinOps, DevSecOps, and production-grade open-source operations tooling.ι’εη°δ»£β¦