Views
No views yet

Full-precision model: DJLougen/Ornstein3.6-35B-A3B-RYS | Uncensored version: DJLougen/Ornstein3.6-35B-A3B-RYS-SABER
| Quantization | Use Case |
|---|---|
| Q8_0 | Best quality, highest memory |
| Q6_K | Near-lossless, good for 48GB+ VRAM |
| Q5_K_M | Excellent quality/size balance |
| Q5_K_S | Slightly smaller Q5 |
| Q5_0 | Legacy Q5 format |
| Q4_K_M | Recommended default for 24GB VRAM |
| Q4_K_S | Smaller Q4 variant |
| Q4_0 | Legacy Q4 format |
| Q3_K_L | Low memory, acceptable quality |
| Q3_K_M | Lower memory |
| Q3_K_S | Aggressive 3-bit |
| Q2_K | Minimum viable quality |
llama-cli -m Ornstein3.6-35B-A3B-RYS-Q4_K_M.gguf -p "Your prompt here" -ngl 99ollama run hf.co/DJLougen/Ornstein3.6-35B-A3B-RYS-GGUF:Q4_K_M