We are ranked 3th on the overall leaderboard and 1st in the 7B
Hugging Face Leaderboard!! 🔥🔥🔥
Finetune DPO viethq188/LeoScorpius-7B with
Nectar dataset
You can use alpaca template.
template_format = """{system}
### Instruction:
{prompt}
### Response:
"""