Views
No views yet
| Filename | Type | Size | Quality |
|---|---|---|---|
| LlamaAligned-DeepSeekR1-Distill-70b-Q4_K_M.gguf | Q4_K_M | 42.5GB | OK quality, default. |
| LlamaAligned-DeepSeekR1-Distill-70b-Q8_0.gguf part1 part2 | Q8_0 | 75.0GB | Best quality quantised version. |
| LlamaAligned-DeepSeekR1-Distill-70b-Q3_K_S.gguf | Q3_K_S | 30.9GB | Lower quality. |
| Filename | Type | Size | Quality |
|---|---|---|---|
| LlamaAligned-DeepSeekR1-Distill-8b-Q4_K_M.gguf | Q4_K_M | 4.92GB | OK quality, default. |
| LlamaAligned-DeepSeekR1-Distill-8b-Q8_0.gguf | Q8_0 | 8.54GB | Best quality quantised version. |
| LlamaAligned-DeepSeekR1-Distill-8b-Q6_K.gguf | Q6_K | 6.6GB | High quality. |
| LlamaAligned-DeepSeekR1-Distill-8b-Q5_K_M>.gguf | Q5_K_M> | 5.73GB | Good quality. |
| LlamaAligned-DeepSeekR1-Distill-8b-Q3_K_S.gguf | Q3_K_S | 3.66GB | Lower quality. |