Quantization made by Richard Erkhov.

Orthocopter_8B - bnb 4bits

license: apache-2.0 language:

This model is thanks to the hard work of lucyknada with the Edgerunners. Her work produced the following model, which I used as the base:

I then applied two handwritten datasets over top of this and the results are pretty nice, with no refusals and plenty of personality.