Kimi-K3 0.40B GGUF validation fixtures
GGUF conversions of the tiny Kimi-K3 0.40B development checkpoints.
These files are intended for:
- Kimi-K3 architecture validation;
llama.cpp conversion and inference testing;- MXFP4 MoE layout testing;
- out-of-core expert-loading research.
They are not intended as useful language models and should not be treated as
quality proxies for the full Kimi-K3 model.
Files
Kimi-K3-0.40B-F16.gguf
Reference F16 conversion of:
inference-optimization/Kimi-K3-0.40B
Kimi-K3-0.40B-MXFP4.gguf
Hybrid conversion of:
inference-optimization/Kimi-K3-0.40B-MXFP4
Representation:
- 168 routed expert projection tensors remain in MXFP4;
- they are repacked into 21 GGUF expert groups;
- 35 resident MoE tensors are dequantized to F16;
- unknown packed tensors are rejected by the converter.
Converter
Converted with:
- repository:
murillo128/llama.cpp
- branch:
k3/out-of-core
- converter commit:
84245db4c790af22135f34992689edcc11877003
See conversion-manifest.json for:
- exact source revisions;
- generated file sizes;
- SHA-256 checksums;
- conversion counts;
- Python package versions.
Smoke-test prompt
According to all known lawsBoth F16 and hybrid MXFP4 fixtures were loaded and executed successfully using
the CPU backend. The observed fixture continuation was:
the start.
This is only a loading and execution smoke test, not a correctness or quality
benchmark.
Project
These artifacts support the k3-out-of-core project, which explores tiered
resident, RAM, and NVMe storage for routed MoE experts in llama.cpp.
