- Conduid
- Marketplace
- #gguf
MCP servers tagged gguf
41 live MCP servers tagged "gguf", ranked by trust score. Tags come from package metadata and repository topics, so this list covers servers across every category that work with gguf.
Comfyui LLM Party
LLM Agent Framework in ComfyUI includes MCP sever, Omost,GPT-sovits, ChatTTS,GOT-OCR2.0, and FLUX prompt nodes,access to Feishu,discord,and adapts to all llms with similar openai…
Clarity
Rust 原生个人 AI 运行时：单二进制编排 LLM、MCP 工具、BM25+向量记忆。支持 TUI / 桌面 GUI / Web IDE / 无头 CLI / 系统托盘。本地优先，AGPL-3.0。
OGAM
The Swiss Army Knife of Offline AI. Chat, see, speak, and generate images on your phone or Mac — GGUF LLMs, vision, Whisper speech-to-text, Stable Diffusion, tool calling, and loc…
Atomic Chat
Local AI app and inference engine for agents. Run open-weight LLMs locally — private, 100% offline on your computer.
Atomic Agent
Local First Ai Agent. Optimized for Local Ai models. Long context window. Proper tools callings. Runs privately on your device.
ETOS LLM Studio
A native LLM client for iOS & Apple Watch. Run local GGUF models offline via llama.cpp, or connect to OpenAI/Claude/Gemini. Features local RAG, Model Context Protocol (MCP) tools,…
OGAD
Off Grid AI — private, on-device AI. Run open models (text, vision, image, voice) locally through one OpenAI-compatible gateway. No cloud, no accounts, no API keys.
Unch
Local-first semantic code search for repository annotations via GGUF embeddings and sqlite-vec.
Fak
Agentic Runtime
SwarmLLM
Decentralized peer-to-peer LLM inference network. Single Rust binary, BitTorrent-inspired incentives, OpenAI-compatible API.
Aictl
🤖 Native AI agent for your terminal and macOS desktop. Run cloud and local models through one secure runtime.
Oxi
Native, local-first coding-agent desktop app in Rust (egui) — run any model: local GGUF, Ollama/LM Studio, SSH-tunneled runtimes, hosted APIs, or Claude Code / Cursor / Codex over…
Jev Style
Small, calibrated decision models on your own machine: systemone-compatible local server, 6 agent skills, Claude Code guard, MCP tools. Weights on Hugging Face.
VLS 32M Context Local LLM
Give Claude Code, Codex and opencode a 32M-token memory that never leaves your machine. Local LLM server (MCP + OpenAI API) that runs any GGUF model with a context far larger than…
Rei
Rei Agent. A local-first agent you assemble yourself.
Vscode Local LLM
VS Code extension to run local LLM models — no cloud, no API keys
Localm
Run local LLMs fully offline - chat, coding agent, image & music generation, knowledge/RAG, voice. Privacy-first, one CLI, no cloud required.
Exe AI Terminal
A beautifully designed AI agent harness — your entire workflow in a single window. Local models first, privacy by default.
Unvara
Private AI that runs on your own computer: a local LLM chat and coding agent for Windows with hardware-aware model picks, one-click downloads and MCP connectors.
Fituna
Stop guessing your llama.cpp config. Give it a target tok/s and a quality budget, and it measures quantization levels and GPU offload on your own machine to find the lightest setu…
Local LLM Orchestrator
Private OpenAI-compatible orchestrator for llama.cpp multi-model routing, prompt improvement, MCP tools, and Skill-Agents workflows.
Tiny Decision
? Tiny Decision - A Local Harness & Deployment Platform for System One Models. In-process GGUF/ONNX runtime, calibrated confidence, visual DAG pipelines, and MCP export.
Codex Multi Model Workers
Codex plugin for MoE4All, GLM, DeepSeek, and OpenAI-compatible model workers through a controlled MCP boundary.
Fornax
Run open models locally: chat, images, speech, decisions, and an OpenAI-compatible API.
Local LLM MCP
本地模型管家 MCP：管理 GGUF 模型与 llama-server —— 模型台账 / 显存估算 / 服务生命周期 / chat 代理（FastMCP）
Compress Tokens
MCP server that compresses text by removing unnecessary tokens using local LLM surprisal scoring
ShipItAndPray/mcp-turboquant
LLM quantization via tool call. Convert models to GGUF, GPTQ, and AWQ formats. Recommend optimal quant settings, evaluate quality, and push to Hugging Face Hub.
Diffusion LLM MCP
FastMCP fleet MCP server for diffusion LMs (dLLM). DiffusionGemma on Goliath RTX 4090 — batch inference, HLE-shaped reasoning, ~200–400 tok/s. Doc phase; llama-diffusion-cli sidec…
Inferbench
Benchmark local LLM inference speed (tokens/sec) on your own hardware — llama.cpp native + cloud APIs, 124-model catalog, optimal-quant picker, and an MCP serve mode.
Modeldock
The home port for your local AI. Zero-install Mac app + MCP server: talk to Claude to discover, download and verify Hugging Face models straight to your own drive. By CAIO Group.
Swift Mlx Forge
Native Apple Silicon AI workbench for local MLX/GGUF models, adjustable reasoning, visual agent graphs, MCP, and an OpenAI-compatible API.
Molla
Local inference server in pure Mojo. Speaks OpenAI, Anthropic, and MCP. Models are OCI artifacts. Same source runs on CPU, NVIDIA, AMD, and Apple GPUs. Apache-2.0 all the way down.
Cancerbero
Local, offline-first GGUF and llama.cpp pre-load inspector
Llama Launcher
Profile-based launcher for local LLM servers - start, stop and switch models on llama.cpp, Ollama and LM Studio from one CLI/TUI. Zero resident overhead, optional MCP control plan…
Comfyui LLM Partyy
LLM Agent Framework in ComfyUI includes MCP sever, Omost,GPT-sovits, ChatTTS,GOT-OCR2.0, and FLUX prompt nodes,access to Feishu,discord,and adapts to all llms with similar openai…
GemmaM5 1 FullStack
Repeatable and auditable local Gemma 4 26B A4B QAT setup for MacBook Air M5 (24 GB) with vision, reasoning, documents, controlled tools, MCP and local APIs. No model weights inclu…
LMStudio Windows 11 Controller
This is a smart desktop controller that allows smaller LLM (8B 20B) GGUF to controll the Windows 11 desktop.
Elyxndra Local
Private, local AI chat for macOS & Windows. Run open LLMs (Llama, Qwen, Mistral - any GGUF via llama.cpp, MTPLX on Apple Silicon) 100% offline on your own hardware: no account, no…
Epa
A confined generation tool: runs an LLM over a local directory read-only and emits the output as a product that is always labeled untrusted. CLI + stdio MCP server on the myelin s…
Tiancode
Tiancode by ZenithAI: local-first agentic coding. Windows desktop app + CLI for Windows, macOS and Linux (GGUF local models, 14 specialists, live preview, voice, MCP).
ShadowCode
Linux desktop coding agent: one picker for your Codex, Claude Code, Cursor, Antigravity and Grok subscriptions, hundreds of OpenRouter models, or local GGUF models on llama.cpp.