Quantization made by Richard Erkhov.
I'm experimenting with the weight matrices in neural networks.
This is a clone of Mistral-7B-v0.1 with some weight matrices replaced.
I'm interested in seeing how the adjustmenets affect performance on existing metrics.
Research in progress! Demons could come out of your nose if you use this.
A modification of
mistralai/Mistral-7B-v0.1.
Thanks to their team for sharing their model.
Use your own risk.
I have no idea what this model's biases and limitations are.
I just want to see if the benchmark values are similar to those from Mistral-7B-v0.1.
I am setting up a long computational experiment to test some ideas.
