Views
No views yet
| File | Size |
|---|---|
gemma-4-31B-Claude-4.6-Opus-Reasoning-Distilled-Q3_K_M.gguf | 15.3 GB |
gemma-4-31B-Claude-4.6-Opus-Reasoning-Distilled-Q4_K_M.gguf | 18.7 GB |
gemma-4-31B-Claude-4.6-Opus-Reasoning-Distilled-Q5_K_M.gguf | 21.8 GB |
gemma-4-31B-Claude-4.6-Opus-Reasoning-Distilled-Q6_K.gguf | 25.2 GB |
gemma-4-31B-Claude-4.6-Opus-Reasoning-Distilled-Q8_0.gguf | 32.6 GB |
Q4_K_M provides the optimal balance between inference speed, memory consumption, and preserving the model's reasoning accuracy.<end_of_turn>llama.cpp CLI./llama-cli -m gemma-4-31B-Claude-4.6-Opus-Reasoning-Distilled-Q4_K_M.gguf -p "Prove that the square root of 2 is irrational." -n 1024