llm-jp/

llm-jp-4-8b-thinking-dpo-data

	llm-jp-4-8b-thinking-dpo-data




	
	Overview

This dataset is a Direct Preference Optimization (DPO) dataset used to train llm-jp-4-8b-thinking. It is constructed by pairing multiple candidate responses for a given prompt and selecting preferred (chosen) and non-preferred (rejected) responses. The splits reasoning_low, reasoning_medium, and reasoning_high correspond to different reasoning effort settings used during response generation. The fields chosen_analysis, chosen_final… See the full description on the dataset page: https://huggingface.co/datasets/llm-jp/llm-jp-4-8b-thinking-dpo-data.