1. Conduid
  2. Marketplace
  3. #llm-gateway
Tag

MCP servers tagged llm-gateway

66 live MCP servers tagged "llm-gateway", ranked by trust score. Tags come from package metadata and repository topics, so this list covers servers across every category that work with llm-gateway.

66
live servers
39
avg trust
13K
most stars
1

Gateway

Portkey-AI

A blazing fast AI Gateway with integrated guardrails. Route to 200+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.

★ 13Kupdated 4 months agoMIT
92
2

AI Gateway

Azure-Samples

Labs to explore AI Models, MCP servers, and Agents with the AI Gateway powered by Azure API Management and Microsoft Foundry 🚀

★ 999updated a month agoMIT
92
3

Tyk

TykTechnologies

Open Source API and AI Gateway supporting REST, GraphQL, TCP, gRPC and MCP (Model Context Protocol)

★ 11Kupdated 15 days ago
64
4

Casdoor

An open-source AI-first Identity and Access Management (IAM) /AI MCP gateway and auth server with web UI supporting MCP, A2A, OAuth 2.1, OIDC, SAML, CAS, LDAP, SCIM, WebAuthn, TOT…

64
5

Casbin Gateway

apache

See what every AI coding agent on your machine is doing, and whether the API behind it is the one you paid for. Claude Code, Codex, Cursor, Gemini CLI and more: one endpoint for 4…

★ 637updated 8 months ago
59
6

Kiwi Mem

LucieEveille

🥝 Self-hosted memory gateway for AI companions — OpenAI-compatible proxy with vector search, memory heat, Dream consolidation and calendar-level summaries · AI 伴侣记忆网关:向量搜索、记忆热度、Dr…

★ 292updated a month ago
52
7

1flowbase

1flowbase: self-hosted AI gateway with protocol translation, dispatch, chat logs, built-in backend & React blocks to combine AI with business data. All managed by your Agent via M…

52
8

Bitrouter

The context-aware model router that learns & adapts to your long-horizon coding agent workflows. Lightweight & extensible, works with any harnesses, any models, any loops.

52
9

Serein

Yinglianchun

雨落下的地方,记忆会再次开花。可自部署的 AI 长期记忆与聊天网关。Self-hosted AI memory & chat gateway for long-term conversations.

★ 75
44
10

Preloop

The open-source AI agent control plane: MCP firewall, model gateway with budgets, human approvals, runtime observability, and audit trails

44
11

Byok Relay

Bring your own key (BYOK) relay to enable lightweight frontend-only apps to use LLMs using the user's API keys without hitting CORS.

44
12

Nexus Cloud

Nexilume-AI

Nexus — execution infrastructure for AI agents. Host agents in the cloud or behind NAT; let users attach and authorize their own computers and Android phones. Deploy once, work ac…

★ 25
39
13

Aiplane

croit

croit AIplane — one plane for all your AI. Self-hosted AI infrastructure connecting applications and users with models, agents, tools and enterprise data: an OpenAI-compatible LLM…

★ 23updated 7 days ago
39
14

Trustgate

Open-source AI gateway for LLM and agent traffic — multi-provider routing, guardrails, semantic caching and MCP support. Written in Go.

★ 11
39
15

LLM Shield Proxy

ninadphalak

Streaming privacy for LLM apps: pii-leak-benchmark (does your gateway leak PII in streams?), chunk-invariance (one-line test for split-boundary leaks), mcp-ssrf-check, and a self-…

★ 10updated 10 days ago
39
16

N2 QLN

n2-QLN: Intelligent Tool Router & Semantic Search Layer for MCP. Connect 1,000+ tools through 1 interface. Prevent AI model confusion and maximize context window efficiency

39
17

Gravitee AI Agent Workshop

Hands-on workshop to explore Gravitee’s AI Management Platform: expose, secure, and govern AI Agents, LLMs and MCP servers

39
18

Awesome AI Gateway

⚡ Awesome AI Gateway — curated comparison of 100+ AI gateways & LLM proxies (LiteLLM, OpenRouter, Portkey, Kong, Higress, new-api, Bifrost) by cost, security, compliance & self-ho…

39
19

IHUI AI

Eight-platform full-stack AI operating system - unifies 176 LLMs via LangGraph + MCP + A2A. Multi-tenant RLS over 340 tables, RAG knowledge base, agent marketplace. Web/API/CLI/De…

39
20

Stdapi.ai

Self-hosted AI gateway for Amazon Bedrock. OpenAI, Anthropic and Cohere compatible APIs, plus Amazon Polly, Transcribe and Comprehend.

39
21

Hecate

AI workspace and runtime for projects, chats, providers, memory, approvals, and supervised agents.

39
22

Ilter

Self-hosted AI gateway in a single Go binary — MCP gateway, budget limits, PII masking, smart router, and others.

39
23

Adaptive LLM Gateway

Self-hosted LLM gateway that turns flat-rate AI subscriptions (Claude Code Max, ChatGPT Plus, Codex, Copilot, M365, Gemini) into one OpenAI/Anthropic-compatible API. Unified subsc…

39
24

Deltallm

Route, manage, and analyze your LLM requests across multiple providers with a unified API interface

39
25

StackFerry

A focused desktop provider manager and router for AI coding tools.

39
26

Hyperagent Openai Gateway

OpenAI-compatible API gateway for Hyperagent.com (MCP upstream) — point any OpenAI client at your agents.

39
27

Dvara

dvarahq

AI Governance Platform - LLM Gateway, MCP Gateway, A2A Gateway.

★ 5updated 5 days ago
34
28

CoworkerAPI

dat-hoangnguyentuandat

Local gateway exposing OpenAI- and Anthropic-compatible endpoints backed by ChatGPT through an official MCP widget.

★ 5
34
29

Kiro Acp Gateway

robert-mcdermott

OpenAI- and Anthropic-compatible API gateway for Amazon Kiro's ACP agent, plus a Python ACP client library and CLI.

★ 5updated 29 days ago
34
30

Hippo

mahdi-salmanzade

A Go LLM client with a memory. Every provider, cost-aware, single binary.

★ 3updated 5 months ago
34
31

Sensei

SenseiIssei

Self-hosted AI workspace that compresses prompts before they leave your machine — 79% fewer tokens, measured. Drop-in gateway for Claude Code, Cursor, Aider and any OpenAI/Anthrop…

★ 2updated 2 months ago
34
32

Rlcd Gateway

JimmyWesley

Self-hosted gateway for LLMs and decision models. Claude Code, Codex, OpenCode and any OpenAI/Anthropic SDK app reach any provider (OpenRouter, Groq, Ollama…) with context pruning…

★ 2updated 23 days ago
34
33

Torana Edge

torana-edge

Hook into every step of your AI coding agent: Claude Code, Codex, Gemini or any other. A programmable local proxy: rewrite requests, swap models, transform streams and tool output…

★ 2updated 14 days ago
34
34

Omniswarm

ajankuv

Self-hosted trust layer for cheap AI: offload bulk LLM work to free models, QC'd by a multi-model council — a vetted answer + confidence verdict at $0. OpenAI-compatible.

★ 1
34
35

Modeldesk

gao-shu

本机多模态 AI 配测台,支持模型对比与 OpenAI 兼容网关。

★ 1updated 2 months ago
34
36

Sandbase Docs

sandbaseai

Official SandBase developer documentation: one API for LLMs, image, video, audio, embeddings, real-world APIs, and reusable Agents.

★ 1
34
37

DeepSeek Infra

leizd

Local-first Agentic AI Infrastructure Platform with LLM Gateway, Agent DAG Runtime, MCP Tool Hub, A2A Agent Mesh, Local RAG, Tool Sandbox and Observability.

★ 1updated 19 hours ago
34
38

Apex MCP Gateway Kernel

AAH20

The Apex MCP Gateway & Inference Router Kernel: Solving NP-Hard Bottlenecks via Alien's Trick, Radix KV-Cache, Conformal Cascading, Link-Cut Trees, SWAR Bitsets, and KKT Water-Fil…

★ 1
34
39

Nano LLM Proxy

kmmuntasir

Tiny single-binary LLM gateway — pool multiple providers and API keys behind one OpenAI/Anthropic-compatible endpoint, with smart key rotation and an embedded admin GUI

★ 1updated 20 days ago
34
40

LLM Hops

YauhenBichel

See every hop of a request through your local LLM system: a tracing server, a live flow map, a waterfall per request, and an MCP server for Claude Code and Cursor. One static Go b…

★ 1updated 21 days ago
34
41

Riz

Self-hosted AWS Lambda runtime — HTTP API Gateway v2 + WebSocket, Bun/Node.js/Python/Rust handlers, built-in MCP server + OpenAI-compatible LLM gateway. Single Rust binary.

34
42

Ollabridge

OllaBridge transforms your laptop or workstation into a production-grade, OpenAI-compatible LLM provider. It features self-healing setup, built-in security, and automatic tunnelin…

34
43

Bifrost Plugin

Claude Code + Claude Desktop plugin for any Bifrost MCP gateway: one-command setup, skill discovery, agent-driven memory, signed admin policy, and OAuth 2.1 for Desktop.

34
44

LLM Gateway

LLM Gateway - Multi-provider LLM access platform

34
45

MCPConnectionHub

MCP Connection Hub - A unified Model Context Protocol Gateway

34
46

Ferentin Service Edge

Hardened LLM and MCP gateway container — deployment recipes for the customer-edge service-edge image with policy enforcement, mTLS, and multi-provider routing.

34
47

PySetuAI CE

The open-source, extensible LLM gateway and agentic MCP proxy. Build, audit, and route prompts to 100+ LLMs with unified telemetry and access controls

34
48

AI Security

Open-source, self-hosted Fastest AI security gateway for LLM and agent apps: guardrails, agentic PDP, semantic caching, MCP gateway.

34
49

Freellmapi Extended

Free OpenAI-compatible LLM gateway & aggregator — 150+ free models, 15+ providers, health-aware routing + automatic fallback. Self-hosted, MIT.

34
50

Memory Platform

让 AI 跨对话记住你。Local-first, auditable AI memory for OpenAI-compatible clients and MCP.

34
← Previous Page 1 of 2 Next →