Views
No views yet
llama.cpp-compatible runtimes.| File | Reported size | Practical use |
|---|---|---|
Qwen3.5-2B.BF16.gguf | 3.90 GB | Highest-fidelity GGUF build |
Qwen3.5-2B.Q8_0.gguf | 2.08 GB | High-quality quantized build |
Qwen3.5-2B.Q4_K_M.gguf | 1.31 GB | Recommended local starting point |
Qwen3.5-2B.BF16-mmproj.gguf | repository artifact | Multimodal projector; see caveat below |
1llama-cli \
2 -hf reaperdoesntknow/Qwen3.5-2B-CyberSec-GGUF:Q4_K_M \
3 --jinjaollama run hf.co/reaperdoesntknow/Qwen3.5-2B-CyberSec-GGUF:Q4_K_M