Lewdiculous/
L3.1-8B-Niitama-v1.1-GGUF-IQ-Imatrix

Name: L3.1-8B-Niitama-v1.1-GGUF-IQ-Imatrix
Availability: InStock

like

0

Views

No views yet

"Lllama 3.1 experiments."

[!TIP] Use the latest version of KoboldCpp.

[!NOTE] Q4_0 ARM/Mobile quants here: L3.1-8B-Niitama-v1.1-GGUF-ARM-Imatrix-Supplementary.

My GGUF-IQ-Imatrix quants for Sao10K/L3.1-8B-Niitama-v1.1.

Lewdiculous/L3.1-8B-Niitama-v1.1-GGUF-IQ-Imatrix