Views
No views yet
| Stage | Accuracy |
|---|---|
| SFT | 93.3% |
| DPO Iter 1 | 96.8% |
| DPO Iter 2 | 98.1% |
1from transformers import AutoModelForCausalLM
2model = AutoModelForCausalLM.from_pretrained(
3 "Moonlight556/sokrates-qwen3-8b-prontoqa-oak-dpo-iter2",
4 torch_dtype="bfloat16"
5)