Quantization made by Richard Erkhov.
This llama model was trained 2x faster with
Unsloth and Huggingface's TRL library.
Additional thanks to @nicoboss for giving me access to his private supercomputer, enabling me to provide many more quants, at much higher speed, than I would otherwise be able to.