- Conduid
- Marketplace
- #quantization
MCP servers tagged quantization
10 live MCP servers tagged "quantization", ranked by trust score. Tags come from package metadata and repository topics, so this list covers servers across every category that work with quantization.
AI Engineering Interview Questions
Your Cheat Sheet for AI Engineering Interview – Questions and Answers.
Rai
CPU-only LLM inference engine in pure Rust — 4-bit quantized models, hand-written AVX2 kernels, speculative decoding, and a local HTTP/MCP server. No GPU, no Python runtime.
Rai
CPU-only LLM inference engine in pure Rust — 4-bit quantized models, hand-written AVX2 kernels, speculative decoding, and a local HTTP/MCP server. No GPU, no Python runtime.
Rostam
Open-source vector database and sub-microsecond key-value store in one Go engine — embed it as a library, run it standalone, or replicate it across a Raft cluster. HNSW/IVF/Vamana…
Fituna
Stop guessing your llama.cpp config. Give it a target tok/s and a quality budget, and it measures quantization levels and GPU offload on your own machine to find the lightest setu…
Semlith
A fast local vector store for AI agents — index files once, keep it current as you save, and answer questions across all of it in milliseconds without leaving the machine.
ShipItAndPray/mcp-turboquant
LLM quantization via tool call. Convert models to GGUF, GPTQ, and AWQ formats. Recommend optimal quant settings, evaluate quality, and push to Hugging Face Hub.
Qwen3.8 Flash Next Single DGX Spark
Serve Qwen3.8-Flash-Next NVFP4 on a single DGX Spark with TP=1 using this self-contained recipe.
JS PotatoRAG
Consola RAG local air-gapped + memoria para agentes (MCP). Base vectorial cuantizada en 3 bits (Rust/WASM, ~21x), embeddings ONNX y LLM locales, PWA instalable.
LLM Inference Lab
Professional open-source LLM inference benchmarking and optimization toolkit: Transformers, vLLM, llama.cpp, quantization analysis, and GPU profiling.