1. Conduid
  2. RAG
  3. With Local LLM
MCP server · RAG

With Local LLM

by · github.com/Gerr1ck/MCP-with-local-LLM

This project demonstrates running the Phi-3.5-mini-instruct LLM model locally on a Snapdragon Elite X NPU, enhanced with Model Context Protocol (MCP) capabilities.

Unclaimed last commit a year ago rag
InstallView source
34Low

Scored a month ago · breakdown

About With Local LLM

With Local LLM is an MCP server published by Gerr1ck in the RAG category: this project demonstrates running the Phi-3.5-mini-instruct LLM model locally on a Snapdragon Elite X NPU, enhanced with Model Context Protocol (MCP) capabilities.

The repository has 1 stars and 0 forks, with the last commit a year ago. Six months or more without a commit doesn't mean the server is broken, but check the open issues before depending on it in production.

Install

From source
git clone https://github.com/Gerr1ck/MCP-with-local-LLM

This server has no ConduID identity, so agent calls to it are not receipted. Pin the version you install and review the source before granting it credentials.

Ask AI

✦

Ask AI about With Local LLM

Powered by Claude · Grounded in docs

I know everything about With Local LLM. Ask me about installation, configuration, usage, or troubleshooting.

Security checks

6 checks have not been run yet.

Questions

About With Local LLM

How do I install With Local LLM?

No package has been published for this server, so install it from source: clone the repository and follow its README.

Is With Local LLM safe to use with an AI agent?

Its trust score is 34 out of 100 (low). Conduid hasn't run static security checks on this repository yet, so review the source yourself before granting it credentials. It has no ConduID identity yet, so agent calls to it are not receipted.

Is With Local LLM still maintained?

The last commit was a year ago. That's long enough that you should check whether the maintainer is responding to issues before depending on it.