📦

Smg

Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across SGLang, vLLM, TRT-LLM, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth.

0 installs

Trust: 52 — Fair

Rag

Ask AI about Smg

Powered by Claude · Grounded in docs

I know everything about Smg. Ask me about installation, configuration, usage, or troubleshooting.

0/500

Documentation

No README available

Smg

Reviews

Documentation

Security Checklist