- Conduid
- Marketplace
- #llama-cpp
MCP servers tagged llama-cpp
109 live MCP servers tagged "llama-cpp", ranked by trust score. Tags come from package metadata and repository topics, so this list covers servers across every category that work with llama-cpp.
OGAM
The Swiss Army Knife of Offline AI. Chat, see, speak, and generate images on your phone or Mac — GGUF LLMs, vision, Whisper speech-to-text, Stable Diffusion, tool calling, and loc…
Chat Studio
A Next.js chat workspace featuring server-side AI orchestration, cross-session memory, and native visualization of llama-server metrics.
Atomic Agent
Local First Ai Agent. Optimized for Local Ai models. Long context window. Proper tools callings. Runs privately on your device.
ScreenMind
AI-powered screen memory — captures, analyzes, and lets you search/chat your screen history. Powered by Gemma 4 . 100% local, 100% private.
ETOS LLM Studio
A native LLM client for iOS & Apple Watch. Run local GGUF models offline via llama.cpp, or connect to OpenAI/Claude/Gemini. Features local RAG, Model Context Protocol (MCP) tools,…
Warpdrv
Local LLM Server Manager + LlaMA.cpp + Chat
Omniglass
AI that acts on your screen, not just reads it. Snip → execute. MCP plugins, sandboxed, local LLM.
Universal Intelligence
◉ Universal Intelligence: AI made simple.
Assist
FileAsist, a file organization agent running on small language model, on your local, reading you files, understanding them and organizing it based on your preferences.
Disp8ch
Self-hosted AI workspace where chat becomes visual workflows, multi-agent operations, and reviewable automations. Local memory; local or cloud models
OGAD
Off Grid AI — private, on-device AI. Run open models (text, vision, image, voice) locally through one OpenAI-compatible gateway. No cloud, no accounts, no API keys.
Rag CLI
Local Retrieval-Augmented Generation (RAG) plugin for Claude Code that combines Chroma db vector embeddings with intelligent info retrieval with Multi-Agent Framework (MAF) orches…
Choosekit
Use choosekit as an MCP server.
Anima
A persistent AI character that reads world news, builds memories with retrieval, and evolves an emotional state over time.
CubicLM
CubicLM is a cross-platform AI client for seamless switching between cloud APIs and local, offline inference of custom and uncensored models.
Claude Code Delegate Local
MCP server that delegates Claude Code subagents to local models (LiteLLM/llama.cpp/Ollama), DeepSeek, AWS Bedrock, or any OpenAI/Anthropic-compatible backend — without losing the…
Deskdrop
Android keyboard with local AI (Ollama, Whisper, MCP) or cloud (Gemini, Groq, OpenAI)
Opendot
A terminal AI agent you can fully undo - every file and shell action is snapshotted and reversible. Model-agnostic (any LLM), and connects to 1000+ app tools and MCP servers.
AAOSP
Agentic Android Open Source Project (AAOSP) — Android fork with native LLM system service, MCP-aware apps, and an agent-driven launcher. On-device Qwen 2.5 via llama.cpp. Apps dec…
AIMA
AI-Inference-Managed-by-AI: Go binary for managing AI inference on edge devices
Lokalbot
A local LLM workhorse that keeps a memory of your workday. On-device meeting notes, dictation, autocomplete, and recall for macOS. GPLv3.
LMLocal
LM Local is a local AI chat assistant for Visual Studio 2022/2026 with agentic capabilities. It works with local engines (LM Studio, Ollama, Jan, Llama.cpp) and cloud providers (O…
Dsh Tool Guardian
Tool Guardian as a native DeepSeek Harness (DSH) bundle: keeps tool definitions out of the context window by fronting your MCP servers behind a small native router. A bridge to th…
Apogee
Terminal coding agent for local LLMs (llama.cpp, Ollama, vLLM) and any OpenAI-compatible API. OS-sandboxed autonomy, MCP, sessions. Go.
DuongNAD
⚡ Config & Showcase for Nguyen Anh Duong (DuongNAD) — AI Engineer specializing in Autonomous Agentic Systems, Cognitive Architectures & GenAI Automation
Context Governor
Universal context governor for local-LLM agent CLIs: an OpenAI-compatible proxy + MCP server that keeps context bounded in front of llama-server.
Oxi
Native, local-first coding-agent desktop app in Rust (egui) — run any model: local GGUF, Ollama/LM Studio, SSH-tunneled runtimes, hosted APIs, or Claude Code / Cursor / Codex over…
VLS 32M Context Local LLM
Give Claude Code, Codex and opencode a 32M-token memory that never leaves your machine. Local LLM server (MCP + OpenAI API) that runs any GGUF model with a context far larger than…
Stackchan Local LLM
Your StackChan, your language model, your network — local-first firmware and server kit for the M5Stack StackChan. Voice, face, camera and MCP tools, with nothing sent to a cloud…
Impossible Inference
A self-hosted token-completion server for local open models, with chat and completion APIs, SSE streaming, WebSockets, gRPC, MCP and verified setup.
Vscode Local LLM
VS Code extension to run local LLM models — no cloud, no API keys
TOAR
A production-grade, fully asynchronous C++23 agentic AI runtime that orchestrates ReAct (Reason-Act-Tool) loops with local and cloud LLMs. Zero external dependencies — JSON, corou…
Uncensored Fleet
Deploy a local multi-model LLM fleet (llama.cpp) with an agent harness, hermes memory, and a one-command CLI
Localm
Run local LLMs fully offline - chat, coding agent, image & music generation, knowledge/RAG, voice. Privacy-first, one CLI, no cloud required.
Inferna
An experimental nanobind wrapper around llama.cpp, whisper.cpp, and stable-diffusion.cpp
Talaria Code
Private AI coding agent for VS Code — agentic edits, inline completions, and chat on your local models (Ollama, vLLM, llama.cpp). Local-first, no cloud.
Mnemosyne Hermes Second Brain Agent
A local-first personal AI second brain. Indexes your notes, photos, videos, and audio into a private, semantically searchable archive on your own hardware. No cloud, no telemetry.…
Exe AI Terminal
A beautifully designed AI agent harness — your entire workflow in a single window. Local models first, privacy by default.
Print Kb
Turn recorded expertise into machine-actionable rules with a local LLM — plus a measured record of every way that LLM lied along the way.
Cleetus
Local-first, terminal-first, privacy-first coding agent for llama.cpp, LM Studio, and Ollama.
Nabsun
A browser for AI. Chromium as an execution environment for agents: the browser supplies the tools, page state and permissions — the agent is the program. Ships a local model that…
Unvara
Private AI that runs on your own computer: a local LLM chat and coding agent for Windows with hardware-aware model picks, one-click downloads and MCP connectors.
FlashAgent
The coding agent built for local models. One native binary for your terminal that finds the model your local server has loaded, and tells you whether that model can actually drive…
Wigi LLM
Physical control surface for local LLM fleets — WigiDash buttons.json launcher for one-touch llama.cpp model switching, plus experimental C# widgets.
Dettivo Linux
Private, offline speech-to-text for Linux: push-to-talk dictation into any app, meeting transcription with speaker diarization, and searchable history. Whisper, Parakeet and a loc…
Mindfork Rs
A terminal AI chat written in Rust: local models via llama.cpp or OpenAI, Anthropic, Gemini, Grok and OpenRouter in the cloud, with persistent memory, notes, RAG and tools
Fituna
Stop guessing your llama.cpp config. Give it a target tok/s and a quality budget, and it measures quantization levels and GPU offload on your own machine to find the lightest setu…
Opencode Memory
Persistent semantic memory for AI coding agents — a single Rust MCP server over SQLite + sqlite-vec with local llama.cpp embeddings. Works with opencode, Claude Code, and Codex.
Haechi
Experimental self-hosted AI context enforcement layer for LLM, MCP, vLLM, Ollama, and agent traffic.
Local MCP Search
Windows-first local MCP search for Codex and Claude Code, with local embedding, reranking, and context compression.