This dataset contains base-model generations produced for the degeneration probe experiments.
All generation shards from outputs/generations/base were concatenated, shuffled
reproducibly, split into train, validation, and test, and stored as Parquet.
Rows: 60529
Source files: 444 generations.jsonl shards
Model: swiss-ai/Apertus-8B-2509
Splits: train, validation, test
Split fractions: train=0.8, validation=0.1, test=0.1
Shuffle… See the full description on the dataset page:
https://huggingface.co/datasets/luca-sartori/degeneration-probe-base.