taehyeonkim/

fp16-bf16-int8

This dataset combines FP16, BF16, and SmoothQuant W8A8 + KIVI-INT8 reference artifacts for meta-llama/Llama-3.1-8B-Instruct. It follows the artifact layouts of:

FP16/BF16 W-FP16/A-FP16/KV-FP16 and W-BF16/A-BF16/KV-BF16 SmoothQuant W8A8 + KIVI-INT8 KV

There are three model/KV configurations and three CoT task groups, giving nine task/configuration KV combinations. Weight artifacts are stored once per… See the full description on the dataset page: https://huggingface.co/datasets/taehyeonkim/fp16-bf16-int8.