- Conduid
- Marketplace
- #inference-server
MCP servers tagged inference-server
8 live MCP servers tagged "inference-server", ranked by trust score. Tags come from package metadata and repository topics, so this list covers servers across every category that work with inference-server.
Rapid MLX
Rapid-MLX is an open-source (Apache 2.0) OpenAI- and Anthropic-compatible LLM inference server for Apple Silicon, built on MLX, focused on reliable tool calling for coding agents.…
VLS 32M Context Local LLM
Give Claude Code, Codex and opencode a 32M-token memory that never leaves your machine. Local LLM server (MCP + OpenAI API) that runs any GGUF model with a context far larger than…
Impossible Inference
A self-hosted token-completion server for local open models, with chat and completion APIs, SSE streaming, WebSockets, gRPC, MCP and verified setup.
Basalt
Turn your Mac into a local LLM server: MLX on Metal, OpenAI + Anthropic API + MCP, pure Swift. Point Claude Code at it.
Basalt
Turn your Mac into a local LLM server: MLX on Metal, OpenAI + Anthropic API + MCP, pure Swift. Point Claude Code at it.
Molla
Local inference server in pure Mojo. Speaks OpenAI, Anthropic, and MCP. Models are OCI artifacts. Same source runs on CPU, NVIDIA, AMD, and Apple GPUs. Apache-2.0 all the way down.
GroundCortex
Continuous LoRA fine-tuning as a local service. Watches source files for changes, retrains on change, and hot-swaps the adapter into a live OpenAI-compatible inference endpoint. P…
Caix
caix — native Apple Core AI inference server for Apple silicon (beta): OpenAI/Anthropic API, dashboard, streaming chat with tools/skills/MCP, MTP speculative decoding.