This DPO (Direct Preference Optimization) dataset was generated using watermarked text generation with red/blue token parity sampling. Each prompt has both a red and blue answer for creating preference pairs.

Watermark Configuration

Sampler Type: soft_watermark Soft Mode: True Soft Threshold: 0.95

Sampling Parameters

Temperature: 0.7 Top-p: 0.8 Top-k: 20 Max Tokens: 2048

Statistics

Total Prompts: 12000 Avg… See the full description on the dataset page: https://huggingface.co/datasets/eac123/openhermes-dpo-qwen3-30ba3b-120ksamples.