Views
No views yet
| Link | Type | Size/GB | Notes |
|---|---|---|---|
| GGUF | Q2_K | 4.8 | Very low quality, Not recommended |
| GGUF | Q3_K_S | 5.6 | low quality |
| GGUF | IQ3_M | 5.7 | |
| GGUF | Q3_K_M | 6.1 | lower quality |
| GGUF | Q3_K_L | 6.6 | |
| GGUF | IQ4_XS | 6.8 | balanced speed and quality, recomended |
| GGUF | Q4_K_S | 7.1 | fast, recommended |
| GGUF | Q4_K_M | 7.5 | fast, recommended |
| GGUF | Q5_K_S | 8.6 | |
| GGUF | Q5_K_M | 8.8 | good quality |
| GGUF | Q6_K | 10.1 | very good quality |
| GGUF | Q8_0 | 13.1 | best quality |
| GGUF | F16 | 24.5 | Full precision |