You can deploy this model and start earning money today!

Taichi11/
dpo_dataset_v1

Views

No views yet

	DPO Dataset (Filtered + Structured Boosted)




	
	Base Dataset

u-10bei/dpo-dataset-qwen-cot

Filtering Rules

prompt <= 1024 chars chosen/rejected <= 2048 chars length difference > 80 chars

Structured Data Boost

XML / TOML samples boosted by 1.2x

Final Size

3101 samples

Intended Use

DPO training for Qwen3-4B-Instruct (SFT-initialized) Structured output improvement (XML / TOML) Rejecting any unwanted output

Environment… See the full description on the dataset page: https://huggingface.co/datasets/Taichi11/dpo_dataset_v1.