Views
No views yet
| Link | Type | Size/GB | Notes |
|---|---|---|---|
| GGUF | Q2_K | 19.3 | |
| GGUF | Q3_K_S | 22.8 | |
| GGUF | Q3_K_M | 25.2 | lower quality |
| GGUF | Q3_K_L | 27.3 | |
| GGUF | IQ4_XS | 28.4 | |
| GGUF | Q4_K_S | 30.0 | fast, recommended |
| GGUF | Q4_K_M | 31.8 | fast, recommended |
| GGUF | Q5_K_S | 36.2 | |
| GGUF | Q5_K_M | 37.3 | |
| GGUF | Q6_K | 43.1 | very good quality |
| PART 1 PART 2 | Q8_0 | 55.8 | fast, best quality |
