This model is a fine-tuned version of
ramzanniaz331/gemma3-12b-2048-ds2-sft-v3 on the dpo_dataset_1, the dpo_dataset_2, the dpo_dataset_3, the dpo_dataset_4, the dpo_dataset_5 and the dpo_dataset_6 datasets.
It achieves the following results on the evaluation set:
