pretrain-dataset-T2048-13B – Dataset by tvu-vlinhd11 | AlphaNeural AI

You can deploy this model and start earning money today!

tvu-vlinhd11/
pretrain-dataset-T2048-13B

like

0

text-generation

optimized-parquet

packed-sequences

Views

No views yet

Pretrain Dataset (Tokenized)

This dataset contains tokenized and packed sequences ready for LLM pretraining.

	Dataset Details

Property Value

Sequences 6,474,097

Sequence Length 2048

Tokenizer ./vn_spm_v3_fast2/

Total Tokens 13,258,950,332

Shards 13

Created 2025-12-10

Dataset Structure

Each sample contains:

input_ids: List of token IDs (length: 2048) attention_mask: Attention mask (1 for real tokens, 0 for padding)… See the full description on the dataset page: https://huggingface.co/datasets/tvu-vlinhd11/pretrain-dataset-T2048-13B.