This is an experimental llama2 13B qlora created using the VNTL-v2-1k dataset.
This fine-tune was done to see if 13B would give better results than 7B, but the improvements of it over the base model seem negligible to me, and the eval scores corroborate this.
This fine-tune still needs more testing though, I still have no way to automatically give a score to the models (other than the eval score), so I will probably look into that soon.
