RichardErkhov/

ewqr2130_-_mistral-inst-v02-dpo-8bits

Quantization made by Richard Erkhov.

mistral-inst-v02-dpo - bnb 8bits

take the mistral inst-v02 model and run dpo on it, 6000 epoch. take the mistral inst-v02 model and run dpo on it, 6000 epoch. take the mistral inst-v02 model and run dpo on it, 6000 epoch. take the mistral inst-v02 model and run dpo on it, 6000 epoch. take the mistral inst-v02 model and run dpo on it, 6000 epoch.