Beta
Explore
Marketplace
Neural Labs
Playground
Wallet
Docs
Kimi-K3-QSRT-K2 – AI Model by lukealonso | AlphaNeural AI
You can deploy this model and start earning money today!
lukealonso
/
Kimi-K3-QSRT-K2
like
0
safetensors
kimi_k3
custom_code
moonshotai/Kimi-K3
finetune
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
This is a 2bpw, 8x RTX 6000 (or 6~8x DGX Spark), quant of Kimi K3, with a KLD of only
0.0675
and surprisingly strong coding/benchmark performance.
You'll need a vLLM based on:
https://github.com/local-inference-lab/vllm/tree/dev/infernal-invocation
(docker container soon) b12x for the special kernels required:
https://github.com/local-inference-lab/b12x
