1. Conduid
  2. Marketplace
  3. #local-llm
Tag

MCP servers tagged local-llm

463 live MCP servers tagged "local-llm", ranked by trust score. Tags come from package metadata and repository topics, so this list covers servers across every category that work with local-llm.

463
live servers
37
avg trust
67K
most stars
51

Zeph

A memory-first AI agent that remembers why decisions were made — not just the last message. Runs local (Ollama), cloud (Claude · OpenAI · Gemini), or decentralized TEE. Graph memo…

44
52

Obsidian Local LLM Hub

All-in-one local AI hub for Obsidian — LLM chat with vault tools, MCP servers, RAG, workflow automation, encryption, and edit history. Fully private, no cloud required.

44
53

Git Courer

blak0p

MCP server for Git with local Ollama — zero tokens for git operations

★ 44updated 2 days ago
39
54

Git Courer

MCP server for Git with local Ollama — zero tokens for git operations

★ 43
39
55

NOVA

vincenzo-afk

A local-first Python personal AI assistant for reasoning, memory, voice, vision, automation, and device control.

★ 39updated 29 days ago
39
56

Velocity Local Services

Veloresearch

Velocity Local Services: an app for running LLMs locally on Windows and Linux. Load any GGUF model and chat with web search, tools and schematics, let it use your computer by voic…

★ 34updated yesterday
39
57

Invarail

PeterGreenAppliedAI

The authority plane for local AI agents: a governed, self-hosted agent built so a 7–30B model on your own GPU can drive it. Measured in public.

★ 33updated 17 days ago
39
58

AI Native Linux Icebreaker

a-bhimava

Talk to your computer. Icebreaker transforms natural language into safe Linux actions through isolated AI brains, kernel-enforced sandboxes. An AI-native operating system with tru…

★ 31
39
59

Qwen38 Strix Halo Harness

aic0d3r

Local AI coding agent harness for AMD Strix Halo (Ryzen AI Max+ 395): Qwen3.8 125B on the iGPU, NPU side-jobs, crash recovery, logged benchmarks. Works with any OpenAI-compatible…

★ 28updated yesterday
39
60

Vixl

vixl-ai

Local-first desktop coding agent with BYOK, MCP, and OpenAI-compatible / Ollama hosts

★ 22updated 5 days ago
39
61

Bees Desktop

Bees-bot

Run a team of AI agents on your own computer. Your files, browser sessions and passwords stay local. Works with Claude Code, Codex, hosted or local models, and MCP tools.

★ 14updated 11 days ago
39
62

Rai

Classevelabs

CPU-only LLM inference engine in pure Rust — 4-bit quantized models, hand-written AVX2 kernels, speculative decoding, and a local HTTP/MCP server. No GPU, no Python runtime.

★ 14updated 29 days ago
39
63

Awesome AI Coding Tools

mahmoudsajjadi

Awesome AI Coding Tools (2026): Curated 3-tier taxonomy of coding assistants, CLI agents, local LLMs, MCP servers, and benchmarks

★ 14updated yesterday
39
64

Anima

A persistent AI character that reads world news, builds memories with retrieval, and evolves an emotional state over time.

★ 13
39
65

Aether Agent

A coding agent that lives in your terminal. Local Ollama first, or hosted models through the Aether AI fleet.

★ 13
39
66

HelixAI

medhiclb

Your own AI workspace on your own machines: chat, agents, coding, knowledge bases (RAG) and fine-tuning with local models. Open source (AGPL-3.0).

★ 13updated 14 days ago
39
67

Anima

darxkies

A persistent AI character that reads world news, builds memories with retrieval, and evolves an emotional state over time.

★ 13updated 7 months ago
39
68

Abacusai Bot

abacusai

100% free, open-source personal agents for your messaging apps, tools, and services

★ 12updated 5 days ago
39
69

Moe Sovereign

moe-sovereign

Self-hosted Compound AI System for sovereign environments. Features token-saving complexity routing, deterministic MCP tools for math/logic, configurable expert templates, causal/…

★ 12
39
70

Arcgram

jovesun-lab

Arcgram — an interactive diagram engine for human–AI collaboration: an AI agent draws its reasoning as an auditable node-and-edge flow and self-audits it, delivered as one standal…

★ 12updated a month ago
39
71

Infai

dipankardas011

Local-first AI in your terminal. infai: run llama.cpp and vLLM models from one TUI with launch profiles, live telemetry, and Hugging Face downloads. infaiw: a daemon-based agent h…

★ 12updated yesterday
39
72

Localbrain Releases

HackerChi-Hub

方寸智匣 LocalBrain:本地 AI 大模型、文件工具与语音/图片/视频工作台;Apple Silicon Mac、Windows,Linux 预览版下载。

★ 12updated 21 hours ago
39
73

My AI

gonicolas12

Local-first AI assistant — native desktop app (React + pywebview), 9 specialized agents (code, web, debug, security…), 10M-token vector memory, multimodal (vision + local image ge…

★ 12updated 2 days ago
39
74

Protoagent

nMaroulis

A blazing-fast, local-first AI agent ecosystem. Orchestrate local LLMs with Python, run them in a native Rust terminal, or integrate directly into your editor via ACP.

★ 12updated 4 days ago
39
75

Rai

CPU-only LLM inference engine in pure Rust — 4-bit quantized models, hand-written AVX2 kernels, speculative decoding, and a local HTTP/MCP server. No GPU, no Python runtime.

★ 11
39
76

Claude Code Delegate Local

fegone

MCP server that delegates Claude Code subagents to local models (LiteLLM/llama.cpp/Ollama), DeepSeek, AWS Bedrock, or any OpenAI/Anthropic-compatible backend — without losing the…

★ 10
39
77

Castor

ApatheticMioz

The Universal 245K Agent Microkernel for Local LLMs.

★ 10updated 8 days ago
39
78

Houtini Lm

MCP server that saves Claude Code tokens by delegating bounded tasks to local or cloud LLMs. 93% token savings benchmarked. Works with LM Studio, Ollama, vLLM, DeepSeek, Groq, Cer…

39
79

Ramibot

RamiBot v3.8.0 is a local-first AI security operations platform integrating multi-LLM support, a dynamic red/blue team skill pipeline, MCP tool orchestration, Docker terminal acce…

39
80

AgentRunKit

Lightweight Swift 6 framework for building LLM-powered agents — cloud + on-device inference via MLX on Apple Silicon

39
81

Llcat

cat for LLMs

39
82

Deskdrop

Android keyboard with local AI (Ollama, Whisper, MCP) or cloud (Gemini, Groq, OpenAI)

39
83

Simple LLM CLI

Easily pipe anything into an LLM

39
84

Awesome Hermes Usecases

Curated real-world use cases for Hermes Agent — the self-improving AI agent from Nous Research. Backed by primary sources.

39
85

Brow

Experimental Chrome side-panel browser agent with LangGraph.js, MCP/WebMCP, local models, and semantic browser automation.

39
86

Opencode LLM Proxy

Local AI gateway for OpenCode with tool/function calling — use any model via OpenAI, Anthropic, or Gemini API

39
87

Codex Universal Proxy

Use Ollama,OpenRouter, Gemini, cohere and moonshot ai with Codex plugins, MCP tools, tool_search and apply_patch. Use any plugin you want with any OpenAI compatible api.

39
88

AgentWebSearch MCP

Local WebSearch without API keys - MCP Server for Claude Code, OpenClaw, LM Studio. Parallel search across Naver/Google/Brave using Chrome CDP.

39
89

Kamehadb

KamehaDB is a cross-platform database GUI - AI. Support query via human language

39
90

Cowork To Code Bridge

Let Claude run code on your real machine — safely — from any Claude chat. Bridges Claude Cowork to Claude Code on your Mac/Linux box. One command, idempotent, no open ports.

39
91

Vision Tool

MCP vision server for AI agents, Claude, Cursor, OpenCode, VS Code, local LLMs, Ollama, LM Studio, OpenRouter, Gemini, image analysis, and video understanding.

39
92

Ypipe

The all-in-one, airgapped Local AI. Ypipe bundles a high-performance inference engine, specialized models, and pre-configured MCP servers into a single, self-contained Java execut…

39
93

Allcanuse MCP

一个专为本地环境设计的 MCP 服务端实现,通过对中小型模型深度优化的提示词规范与结构化工具集,赋予本地 Agent 系统操作与感知能力,涵盖文件工程、网络协议调试、进程管控及桌面视觉观察等 90 多个工具,使模型能够从单纯的文本生成器进化为具备自动化执行能力的本地工作智能体

39
94

Learnstead

Local LLM·RAG·AI Agent·바이브 코딩을 개념부터 실습과 검증까지 다루는 학습 자료

39
95

Leather

Local agent infrastructure in one stdlib-only Go binary

39
96

Profclaw

AI agent engine with 22 chat channels, 65 tools, and 15 skills. Self-hosted, local-first, works with any LLM provider.

39
97

AIMA

AI-Inference-Managed-by-AI: Go binary for managing AI inference on edge devices

39
98

Sir Thaddeus

Private, local-first AI assistant for Windows with permissioned tools, durable memory, and evidence-driven small-model improvements.

39
99

Hako Code

A standalone terminal agent in a single C file. Model agnostic (13 providers + local hako), skill-driven, tool permission gated. No node, no python.

39
100

Fak

Agentic Runtime

39
← Previous Page 2 of 10 Next →