MCP servers tagged on-device-llm

4 live MCP servers tagged "on-device-llm", ranked by trust score. Tags come from package metadata and repository topics, so this list covers servers across every category that work with on-device-llm.

live servers

avg trust

most stars

Aria

Swift agent runtime for Apple platforms. Keeps tools, skills and history inside the 4,096-token on-device window, so connecting an MCP server doesn't break the turn. FoundationMod…

★ 4

AAOSP

Agentic Android Open Source Project (AAOSP) — Android fork with native LLM system service, MCP-aware apps, and an agent-driven launcher. On-device Qwen 2.5 via llama.cpp. Apps dec…

TrueNorth

Declare the outcome, skip the logic. The developer-first infrastructure engine for structured, multi-turn AI conversations with built-in safety, async follow-ups, and native compl…

Apfel Harness

Local web GUI harness for Apple Intelligence via the apfel CLI (on-device FoundationModels). Streaming chat with an exact 4k context gauge, JSON-schema constrained decoding, batch…