📦
Candle Vllm
Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.
0 installs
Trust: 59 — Fair
Ai
Ask AI about Candle Vllm
Powered by Claude · Grounded in docs
I know everything about Candle Vllm. Ask me about installation, configuration, usage, or troubleshooting.
0/500
Loading tools...
Reviews
Documentation
No README available