alexkstern/

dyck-k128-seq_len_2048-1B

Procedurally generated k-shuffle Dyck bracket sequences (Hu et al. 2025, arXiv:2502.19249), as flat uint16 token-id .bin files. Token ids are 0-based: opening bracket type i is id i and its matching close is i + k, so ids span [0, 2k) and the vocabulary is 2k = 256. Grammar parameters

param value

k (bracket types) 128

max_depth 16

p_open 0.5

seq_length 2048

file split tokens

train.bin train 999,999,488

val.bin val 10,000… See the full description on the dataset page: https://huggingface.co/datasets/alexkstern/dyck-k128-seq_len_2048-1B.