Views
No views yet
WeiboAI/VibeThinker-3B.| File | Description |
|---|---|
VibeThinker-3B-Q4_K_M.gguf | Recommended general local-use quantization |
VibeThinker-3B-Q5_K_M.gguf | Better quality, larger than Q4_K_M |
VibeThinker-3B-Q8_0.gguf | High quality, larger file |
VibeThinker-3B-F16.gguf | Full precision GGUF, largest file, optional |
llama-cli -m VibeThinker-3B-Q4_K_M.gguf -ngl 99 -c 8192 -cnv