- Conduid
- Marketplace
- #local-llm
MCP servers tagged local-llm
463 live MCP servers tagged "local-llm", ranked by trust score. Tags come from package metadata and repository topics, so this list covers servers across every category that work with local-llm.
Anything LLM
The all-in-one Desktop & Docker AI application with built-in RAG, AI agents, No-code agent builder, MCP compatibility, and more.
Client For Ollama
Harness the power of local LLMs with this TUI MCP Client for Ollama. Featuring all core MCP primitives (tools, prompts, resources), agent mode, multi-server, model switching, stre…
LLM Search
Querying local documents, powered by LLM
Ollama MCP
An MCP Server for Ollama
Omniget
Udemy & Hotmart course downloader, YouTube downloader (yt-dlp GUI, 1,800+ sites) + desktop app for AI agents: Claude Code, Codex, Gemini CLI, Ollama. Permissions, undo, jobs, loop…
Open Multi Agent
Self-hosted TypeScript agent runtime with durable approvals and verifiable run records. Own it, approve it, audit it.
Open Multi Agent
Self-hosted TypeScript agent runtime with durable approvals and verifiable run records. Own it, approve it, audit it.
Ouroboros
Ouroboros — self-creating AI agent. Born Feb 16, 2026.
Rapid MLX
Rapid-MLX is an open-source (Apache 2.0) OpenAI- and Anthropic-compatible LLM inference server for Apple Silicon, built on MLX, focused on reliable tool calling for coding agents.…
Ouroboros
Ouroboros — self-creating AI agent. Born Feb 16, 2026.
Clarity
Rust 原生个人 AI 运行时：单二进制编排 LLM、MCP 工具、BM25+向量记忆。支持 TUI / 桌面 GUI / Web IDE / 无头 CLI / 系统托盘。本地优先，AGPL-3.0。
Local Deep Research
Local Deep Research achieves ~95% on SimpleQA benchmark (tested with GPT-4.1-mini). Supports local and cloud LLMs (Ollama, Google, Anthropic, ...). Searches 10+ sources - arXiv, P…
Awesome Local LLM
A curated list of awesome platforms, tools, practices and resources that helps run LLMs locally
Llmc
One stop shop - Local-first RAG stack with intelligent polyglot-code/docs, remote code execution, local llama enrichment, progressive disclosure tools, mcp server, sandboxed secur…
Code Buddy
Your AI-powered coding companion for Claude Desktop. MCP server with 23+ dev tools for file operations, git integration, code analysis, and more. Works with any project on your sy…
Selfhost AI
One-command installer for a self-hosted AI stack on your own server: n8n, Ollama, Open WebUI, OpenClaw, Dify, Flowise, Supabase, ComfyUI, Qdrant & 30+ tools. Docker Compose, autom…
Box
The most advanced, fully offline client-side AI suite on Android today.
IncarnaMind
IncarnaMind is a free, open-source desktop app for macOS, Windows and Linux where you write with AI and ask questions about your own documents (PDF, Word, PowerPoint, Excel and mo…
IncarnaMind
The AI notebook that checks its own citations. Ask your PDFs, Word files, slides and spreadsheets; answers cite the exact page. Open-source desktop app.
Atomic Chat
Local AI app and inference engine for agents. Run open-weight LLMs locally — private, 100% offline on your computer.
Atomic Agent
Local First Ai Agent. Optimized for Local Ai models. Long context window. Proper tools callings. Runs privately on your device.
Dark Moon
Autonomous AI pentesting engine, continuous offensive security across web, cloud, AD & Kubernetes. Agentic reasoning + real exploit execution deliver proof-based vulnerabilities.…
Awesome AI Companion
Open-source AI companions, desktop pets, long-term memory & proactive chat. 人机恋开源项目大全。让你的家机能够脱离官端自主存在，拥有记忆和主动性。
Local Analyst
Talk to your data locally 💬📊. A private AI Data Analyst built with the Model Context Protocol (MCP), Ollama, and SQLite. Turn natural language into SQL queries without data leavin…
Mindroom
AI agents that know you and your work, in a chat app anyone can use. Open source, any model, self-host or hosted.
Localmind
A mobile application designed to provide a beautiful, fast, and privacy-respecting interface for on device LLM and local LLM servers and cloud providers
Code CLI
Open-source terminal coding agent. Use 15+ model providers, local models or your own key. Plan mode before edits. Imports your Claude Code setup.
RongxinAI
Open-source desktop AI agent: built-in free model, local GGUF models via llama.cpp, dispatch tasks from WeChat/Feishu/DingTalk. Files, browser & MCP tools. | 开源桌面 AI 智能体：内置免费模型，ll…
Agenticos
Open-source AI teammates for your company. The self-hosted agent layer: build, run and govern AI agents on your own servers, models and rules. RAG, skills, a real browser, 4,700+…
Roampal
Memory that learns what works.
Awesome Second Brain
A curated solutions to building a self-evolving second brain that helps AI agents understand your personal and team context.
Synto
More than just Karpathy’s LLM Wiki, 100% local with Ollama. Drop Markdown notes → AI extracts concepts → your Obsidian wiki auto-links and grows. Zero sharing. Your notes stay you…
Bagidea Office
A living AI-agent office on your desktop wallpaper — Claude Code agents that walk, work, delegate, learn & hold meetings. Per-agent swappable models (Claude/GLM/DeepSeek/Qwen/Kimi…
Captain Claw
Self-hosted framework for orchestrating fleets of specialist AI agents — ensemble reasoning and a full agentic coding pipeline, model-agnostic and local-friendly.
Omk
Evidence-gated runner for Codex, Claude Code, OpenCode, and local coding agents. Routes tasks into scoped DAG lanes with replayable artifacts.
Agentty
AI pair programming in your terminal — one static binary, sub-ms startup, any model
Quackd
🦆🧠 Give your small robot a brain. Tell a Microduck, an Open Duck Mini, a Reachy Mini, a LeRobot arm, an XLeRobot cart, an AlohaMini, a ToddlerBot humanoid or any ROS base what you…
Vellium
Local-first desktop AI workbench for roleplay, multi-character chat, long-form writing, RAG, MCP tools, plugins, and local models.
Codebrain
An MCP server that offloads bulk work from Claude Code to a local LLM (Qwen2.5-Coder 14B via Ollama). Claude stays the reasoner; the local model takes the bulk drafting, polishing…
Saki Panel
Next-gen AI-native server ops panel with an in-workspace SRE agent. Crash self-healing, safe rollbacks, Docker/game servers, and local Ollama support.
Loom
Loom is an AI harness, that can be used with local or cloud LLMs, for complex tasks. It decomposes work, drives execution through a verification harness, and keeps models on track…
AgenticOS
Sovereign Agentic AI Layer: your company's AI agents on your servers, models and rules. Skills, context files, 5700+ MCP servers, budgets, approvals and an audit trail. Apache-2.0…
Mu
Self-hosted AI agent framework with permission modes, audit logging and MCP. Runs on your machine, in Docker, or on a Raspberry Pi.
Ollamarama Matrix
Local AI chatbot for Matrix with infinite personalities, tool calling, and MCP — powered by Ollama
HARTOS
An AI-native OS. Models run on your own hardware, nodes federate peer-to-peer with no broker, and the API is OpenAI-compatible. Boots, has its own Wayland compositor, and runs on…
Mindbase LLM Wiki
Karpathy's LLM Wiki idea as a product — an AI that builds and maintains a markdown wiki from your notes and sources. MCP server + web UI, runs on free local models (Ollama), no AP…
OGAD
Off Grid AI — private, on-device AI. Run open models (text, vision, image, voice) locally through one OpenAI-compatible gateway. No cloud, no accounts, no API keys.
FABULA LLM 5
The agent harness that makes small local models finish hard tasks — and prove it. Done is enforced by the engine, not the prompt: gates, rewinds, a judge, and a replayable Proof-o…
Libre Webui
A local-first workspace for chat, private knowledge, artifacts, and isolated model-driven work. Self-hosted. Provider-flexible. Apache 2.0.
Aivy OS
Your own digital life form — local AI companion with persistent memory, IDE workspace, MCP support, and 30+ tools. Companion-first alternative to Hermes Agent / OpenClaw / Claude…