festr2/

kimi-k3-distribution-fidelity-1024x2048-v1

	Kimi K3 distribution-fidelity reference




	


	Status

The artifact is qualified for paired, teacher-forced comparison of Kimi K3 compressed checkpoints against the official MXFP4 checkpoint. It contains 1,024 distinct 2,048-token source contexts and 2,096,128 scored next-token positions. The primary metric is: KL(official MXFP4 distribution || candidate distribution)

The reference stores BF16 hidden states after final RMSNorm and before the language-model head.… See the full description on the dataset page: https://huggingface.co/datasets/festr2/kimi-k3-distribution-fidelity-1024x2048-v1.