RLAIF/

genrm-uf-qwen3-4b-angel-judge-gemma-3-12b-it-jt07-j200-n200-20250729-122052

Judge Model: gemma-3-12b-it genrm-uf-qwen3-4b-angel-judge-gemma-3-12b-it-jt07-j200-n200-20250729-122052

=== DATASET STRUCTURE === Unique problems: 100 Orderings per problem: 2 (original + swapped) Judges per evaluation: 5 Total evaluations: 200 Total judge responses: 1000

=== SCORING SUMMARY === Response 1 wins: 74 Response 2 wins: 121 Ties: 5

Distribution of judge agreement levels: 5-0 unanimous: 151/200 (75.5%) 4-1 strong majority: 25/200 (12.5%) 3-2 narrow majority: 11/200 (5.5%)… See the full description on the dataset page: https://huggingface.co/datasets/RLAIF/genrm-uf-qwen3-4b-angel-judge-gemma-3-12b-it-jt07-j200-n200-20250729-122052.