[!CAUTION]
⚠️ Warning: This model can produce narratives and RP that contain violent and graphic erotic content. Adjust your system prompt accordingly, and use Llama 3 chat template.
🐙 Cthulhu 70B v1 GGUF
Only the Q4_0 is available for now. This runs faster than Q4_K_M with low VRAM.
Update: I have added a few more essential quants, mirrored from mradermacher: IQ4_XS, IQ3_XXS, IQ2_XXS
Team mradermacher has uploaded several more quants, so if you need them in other sizes go here:
