This is a test repo really.
The model works but this was my first push to huggingface.
Deduced how to quantize to gguf after learning how to quantize via bitsandbytes and torchao.
Model loads up significantly faster. Still have to benchmark comparisons.
Anyway, blessings.
