Quantization made by Richard Erkhov.
This is a model that uses the orthogonal feature ablation as featured in this
paper.
I haven't tested the model but like the 8B model, may still refuse some instructions.
Use this model responsibly, I decline any liability resulting of the use of this model.
I will post the code later.
