Views
No views yet
| Name | Quant Method | Bits | Max RAM Required | Usecase |
|---|---|---|---|---|
| TarsChattyBasev0.1-Q4_K_M.gguf | Q4_K_M | 4 | ~6.5 GB | balanced quality |
| TarsChattyBasev0.1-Q5_K_M.gguf | Q5_K_M | 5 | ~7.5 GB | large, very low quality loss |
| TarsChattyBasev0.1-Q8_0.gguf | Q8_0 | 8 | ~10.5 GB | very large, extremely low quality loss |