edornd/

gemma-4-12B-it-FP8D

[!Note] This repository contains a FP8 dynamic version of gemma-4-12B-it, quantized to run on <=16GB VRAM hardware. Given the quantization method, it requires Ada-based or later architectures.