argilla/magpie-ultra-v0.1 filtered
"quality" in ['excellent', 'good']
"## Step 1: " in "response"
"score" >= 0.32
22263 examples
generate one step with qwen-2.5 0.5B for each reasoning step
e.g. ["step 1 reasoning", "step 2 reasoning", "step 3 reasoning"]
generate two completions:
["step 1 reasoning", "generated step 2"]
["step 1 reasoning", "step 2 reasoning", "generated step 3"]
generation params
"max_tokens": 200
"temperature": 0.7
"stop": ["\n## Step"]