Raw stage-1 pre-pretraining corpus from the ppt
research framework, exported for information-theoretic analysis (e.g.
m-local entropy) independent of this repo's training pipeline.
Raw MIDI event-type integers from the MAESTRO dataset (via submodules/tilt-transfer's tokenization scheme), token_offset=0.
These input_ids are not decodable with the Pythia (or any other)
tokenizer. They are integers in… See the full description on the dataset page:
https://huggingface.co/datasets/sashaboguraev/ppt-music-corpus.
