eac123/

my-dpo-dataset

This DPO (Direct Preference Optimization) dataset was generated using watermarked text generation with red/blue token parity sampling. Each prompt has both a red and blue answer for creating preference pairs.

Sampler Type: soft_watermark Soft Mode: True Soft Threshold: 0.95

Temperature: 0.7 Top-p: 0.8 Top-k: 20 Max Tokens: 512

Total Prompts: 32 Avg Red Parity Ratio: 0.6447 Avg… See the full description on the dataset page: https://huggingface.co/datasets/eac123/my-dpo-dataset.