1. Conduid
  2. RAG
  3. SoAI
MCP server · RAG

SoAI

by · github.com/GetSoAI/SoAI

An OpenAI and Anthropic-compatible API in front of llama.cpp, Ollama, vLLM and remote providers, with on-demand backends, queuing, failover and load balancing. Also includes a multi-user WebUI with chat, agents, automations, a RAG knowledge base, GPU monitoring and control.

Unclaimed agentic-aiaiai-agentsanthropic-apicoding-agentsfeature-richgeneral-purpose-aigpu-monitoringllamacppllmllm-agentsmcpollamaopenai-apiorchestrationoverclockingragselfhostedvllmwebapp
InstallView source
34Low

Scored 27 days ago · breakdown

About SoAI

SoAI is an MCP server published by GetSoAI in the RAG category: an OpenAI and Anthropic-compatible API in front of llama.cpp, Ollama, vLLM and remote providers, with on-demand backends, queuing, failover and load balancing. Also includes a multi-user WebUI with chat, agents, automations, a RAG knowledge base, GPU monitoring and control.

The repository has 1 stars and 0 forks, with the last commit 13 days ago. Recent commit activity is the strongest signal that reported issues will get attention.

Install

From source
git clone https://github.com/GetSoAI/SoAI

This server has no ConduID identity, so agent calls to it are not receipted. Pin the version you install and review the source before granting it credentials.

Ask AI

✦

Ask AI about SoAI

Powered by Claude · Grounded in docs

I know everything about SoAI. Ask me about installation, configuration, usage, or troubleshooting.

Security checks

6 checks have not been run yet.

Releases

v1.3.1SoAI 1.3.1 · 4 Oct 20261.3.1 SoAI 1.3.1 fixes Windows installations, lets Linux installations obtain root access on systems where sudo is missing or not permitted, and makes the Linux and macOS installers easier to follow when something goes wrong. It also fixes…
v1.3.0SoAI 1.3.0 · 3 Oct 20261.3.0 SoAI 1.3.0 adds a guided setup that gets a first model running, push-to-talk and a sketch pad in Chat, right-to-left layouts for Arabic and Persian, QR pairing for the SoAI Connect app, and built-in wallpapers. It also lowers idle…
v1.2.1SoAI 1.2.1 · 22 Sep 20261.2.1 SoAI 1.2.1 improves installation and startup reliability after the 1.2.0 release, especially on slower machines and systems with older graphics drivers. Fixes The Windows PowerShell installation command now starts correctly when…
v1.2.0SoAI 1.2.0 · 21 Sep 20261.2.0 SoAI 1.2.0 brings a new SoAIBench scoring method and public leaderboard sharing, makes stopping and regenerating Chat responses more reliable, and improves streaming performance and attachment handling. It also adds per-user OCR…
v1.1.1SoAI 1.1.1 · 13 Sep 20261.1.1 SoAI 1.1.1 changes Windows uninstall so it keeps application data by default, fixes several status and messaging controls in the WebUI, and keeps model and plugin state current through delayed events and restarts. OpenAI-compatible…
Questions

About SoAI

How do I install SoAI?

No package has been published for this server, so install it from source: clone the repository and follow its README.

Is SoAI safe to use with an AI agent?

Its trust score is 34 out of 100 (low). Conduid hasn't run static security checks on this repository yet, so review the source yourself before granting it credentials. It has no ConduID identity yet, so agent calls to it are not receipted.

Is SoAI still maintained?

Yes — the latest release is v1.3.1 (4 Oct 2026), and the last commit was 13 days ago. The repository has 1 stars.