1. Conduid
  2. AI
  3. Rai
MCP server · AI

Rai

by · github.com/Classevelabs/rai

CPU-only LLM inference engine in pure Rust — 4-bit quantized models, hand-written AVX2 kernels, speculative decoding, and a local HTTP/MCP server. No GPU, no Python runtime.

Unclaimed avx2classevecpu-inferencecpu-onlyinference-enginellm-inferencelocal-llmmcp-serverno-gpuquantizationrust
InstallView source
39Low

Scored 5 hours ago · breakdown

About Rai

Rai is an MCP server published by Classevelabs in the AI category: cPU-only LLM inference engine in pure Rust — 4-bit quantized models, hand-written AVX2 kernels, speculative decoding, and a local HTTP/MCP server. No GPU, no Python runtime.

The repository has 14 stars and 0 forks, with the last commit 28 days ago. Recent commit activity is the strongest signal that reported issues will get attention.

Install

From source
git clone https://github.com/Classevelabs/rai

This server has no ConduID identity, so agent calls to it are not receipted. Pin the version you install and review the source before granting it credentials.

Ask AI

✦

Ask AI about Rai

Powered by Claude · Grounded in docs

I know everything about Rai. Ask me about installation, configuration, usage, or troubleshooting.

Security checks

6 checks have not been run yet.

Questions

About Rai

How do I install Rai?

No package has been published for this server, so install it from source: clone the repository and follow its README.

Is Rai safe to use with an AI agent?

Its trust score is 39 out of 100 (low). Conduid hasn't run static security checks on this repository yet, so review the source yourself before granting it credentials. It has no ConduID identity yet, so agent calls to it are not receipted.

Is Rai still maintained?

Yes — the last commit was 28 days ago. The repository has 14 stars and 0 forks.