You can deploy this model and start earning money today!

nicholasbailey87/
parameter-golf-byte260

text-generation

mit

10B<n<100B

Views

No views yet

Parameter Golf FineWeb 10B — Byte260 Tokenization

Byte-level tokenized version of the FineWeb 10B dataset for the Parameter Golf competition. The HuggingFace repo (willdepueoai/parameter-golf) only currently provides fineweb10B_sp1024 in both the manifest and the dataset folders, so I whipped this up instead. It seems to work OK, but use at your own risk as it's vibe coded!

Tokenizer

byte260: 256 UTF-8 byte tokens + 4 special tokens (pad=0, bos=1, eos=2, unk=3). Byte… See the full description on the dataset page: https://huggingface.co/datasets/nicholasbailey87/parameter-golf-byte260.