Paper: arXiv:2607.07964 · Code: GitHub
Pre-computed H_G for Meta-Llama-3-8B, the output-side curvature factor used by KronQ under the K-FAC factorization H ≈ H_X ⊗ H_G. H_G is the per-sublayer empirical-Fisher gradient covariance (E[g gᵀ] over the layer output), distinct from the standard input-side Hessian H_X (built online during calibration).
Publishing this lets you reproduce KronQ quantization without the offline… See the full description on the dataset page:
https://huggingface.co/datasets/donghyunli/Meta-Llama-3-8B-KronQ-HG.
