fhai50032/

BiBo_corpus-4096-packed-qtk-2.05M-hi35-en65

Packed pretraining corpus, 2,050,000 rows x 4096 tokens = 8.397B tokens, tokenized with fhai50032/QTK-81K.

	Format




	

column type notes

label list exactly 4096 tokens, no padding

raw_label string label decoded back to text (redundant, for inspection)

There is no attention_mask column: the corpus is packed, so every position is a real token and the mask would be all ones on every row.… See the full description on the dataset page: https://huggingface.co/datasets/fhai50032/BiBo_corpus-4096-packed-qtk-2.05M-hi35-en65.