You can deploy this model and start earning money today!

AesSedai/
Kimi-K2.6-GGUF

Name: Kimi-K2.6-GGUF
Availability: InStock

Views

No views yet

Model

This is a text-and-image-only GGUF quantization of moonshotai/Kimi-K2.6. This means that video input is not present in this GGUF, and will not be available until support is added upstream in llama.cpp. MMPROJ files for image vision input have been provided.

This Q4_X quant is the "full quality" equivalent since the conditional experts are natively INT4 quantized directly from the original model, and the rest of the model is Q8_0.

Quant	Size	Mixture	PPL	1-(Mean PPL(Q)/PPL(base))	KLD
Q4_X	543.62 GiB (4.55 BPW)	Q8_0 / Q4_0	1.8248 +/- 0.00699	0	0
Q3_K_L	459.94 GiB (3.85 BPW)	Q8_0 / Q3_K / Q3_K / Q4_0	1.911501 ± 0.007586	+3.7768%	0.051626 ± 0.000442
IQ3_S	377.50 GiB (3.16 BPW)	Q8_0 / varies	2.154629 ± 0.009004	+16.9764%	0.175223 ± 0.001218
IQ2_S	311.71 GiB (2.61 BPW)	Q8_0 / varies	2.492466 ± 0.011009	+35.3179%	0.321799 ± 0.001901
IQ2_XXS	262.74 GiB (2.20 BPW)	Q8_0 / varies	3.233051 ± 0.015424	+75.5248%	0.582627 ± 0.002755

AesSedai/Kimi-K2.6-GGUF

Model

AesSedai/
Kimi-K2.6-GGUF