MCP servers tagged batch-inference

2 live MCP servers tagged "batch-inference", ranked by trust score. Tags come from package metadata and repository topics, so this list covers servers across every category that work with batch-inference.

live servers

avg trust

most stars

Vecboost

Kirky-X

Production embedding & decision inference service in Rust — Candle/ONNX dual engine, CUDA/Metal acceleration, REST/gRPC/MCP/CLI generated via sdforge, rerank, Matryoshka dimension…

★ 1updated 27 days ago

Diffusion LLM MCP

FastMCP fleet MCP server for diffusion LMs (dLLM). DiffusionGemma on Goliath RTX 4090 — batch inference, HLE-shaped reasoning, ~200–400 tok/s. Doc phase; llama-diffusion-cli sidec…