- Conduid
- Marketplace
- #inference
MCP servers tagged inference
67 live MCP servers tagged "inference", ranked by trust score. Tags come from package metadata and repository topics, so this list covers servers across every category that work with inference.
Edgemesh
Cross-OS federated gateway unifying every OpenAI-compatible inference backend (Cognis fleet, Ollama, llama.cpp, vLLM) behind one /v1 endpoint
Io Net
io.net — independent third-party profile of a public API surface, by API Evangelist. io.net is a decentralized GPU network for AI compute, built on Solana, that aggregates idle co…
Karakan App Selector Wen
Manage concurrent LLM requests with priority queues, multi-model routing, fault tolerance, and semantic caching for efficient AI workflows.
Moemodels
Open tooling and verifiable evidence for planning, measuring, and reviewing mixture-of-experts deployments.
Dedaluslabs
Dedalus Labs — independent third-party profile of a public API surface, by API Evangelist. Dedalus Labs builds infrastructure for AI agents. It runs two production APIs: the Dedal…
Squirrel
Pure Rust AI coordination — MCP server, multi-provider inference routing, local-first LLM orchestration. Sovereign AI for distributed computing. AGPL-3.0
Wssch
Takes care of you while you code for them 🫰🎇. Planned migration to Rust or C++23 soon.
Runpod Cowork Plugin
RunPod MCP plugin for Claude and Cowork. Manage GPU pods, Jupyter environments, AI jobs, and cloud inference workloads through natural language.
InferFund
Donate AI inference to advance open mathematical problems.
Cid
L.ai · Gate (CID) — per-token validation for LLMs. Catches hallucinations, math errors, and fallacies in real time. 5+ gates, 1,606 facts, 630KB WASM.
AI Engineer Frontier
🔭 AI Engineer Track 3 of 4 — open-weight frontier models, Hermes and the Nous stack, post-training, GRPO, inference engineering, MCP. ~88 hours, 9 phases.
NvHive
Rootless NVIDIA GPU AI lab: local LLMs, ComfyUI, agents, creative/game/music packs, and a self-healing setup wizard.
Kosher
Kosher updates BDD for the AI era.
LLM Inference Lab
Professional open-source LLM inference benchmarking and optimization toolkit: Transformers, vLLM, llama.cpp, quantization analysis, and GPU profiling.
Typescript SDK
Type-safe TypeScript SDK + MCP server for gc4.ai — OpenAI-compatible AI inference, paid for with gift cards.
PortableAi
Fully offline, portable AI agent for Windows/Linux/macOS - llama.cpp launcher with Web UI, OpenAI-compatible API, agent tools, MCP (web search) and reasoning. One-command setup. N…
Localai
LocalAI — independent third-party profile of a public API surface, by API Evangelist. LocalAI is the open-source, self-hosted AI inference engine that acts as a drop-in replacemen…