Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
moonshotai_Kimi-K2-Instruct_GGUF – AI Model by terribleplan | AlphaNeural AI
You can deploy this model and start earning money today!
terribleplan
/
moonshotai_Kimi-K2-Instruct_GGUF
like
0
gguf
moonshotai/Kimi-K2-Instruct
quantized
endpoints_compatible
us
conversational
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
GGUF quants of moonshotai/Kimi-K2-Instruct
Quantization was performed without imatrix for the purposes comparison and experimentation. Perplixity may be worse than expected due to this naive approach.
Read sample outputs of the quants and my report on them
Name
Version
moonshotai/Kimi-K2-Instruct
c2fee60e5323
convert_hf_to_gguf.py
full-b7588
llama-quantize
and
llama-gguf-split
c8a37980419e
See the original model card
here
.