Views
No views yet
customer-support-q4_k_m.gguf - 4-bit quantized (smallest size, good for resource-constrained environments)customer-support-q8_0.gguf - 8-bit quantized (good balance of size and quality)customer-support-q5_k_m.gguf - 5-bit quantized (middle ground)