Views
No views yet
| Variant | Use Case | Download |
|---|---|---|
| Q2_K | Basic text completion tasks | 📥 |
| Q3_K_M | Memory-efficient quality operations | 📥 |
| Q4_K_S | Balanced performance and quality | 📥 |
| Q4_K_M | Balanced performance and quality | 📥 |
| Q5_K_S | Enhanced quality text generation | 📥 |
| Q5_K_M | Enhanced quality text generation | 📥 |
| Q6_K | Superior quality outputs | 📥 |
| Q8_0 | Maximum quality, production-grade results | 📥 |