tokenized-1202-2 – Dataset by Ba2han | AlphaNeural AI

You can deploy this model and start earning money today!

Ba2han/
tokenized-1202-2

like

0

Views

No views yet

Tokenized Dataset (1202-2)

Base Tokenizer: unsloth/Llama-3.2-1B

	Dataset Statistics

Metric Value

Total Rows 3,321,874

Total Tokens 2,248,491,708

Processing Notes

Shuffled: Yes (Seed 42) Format: Parquet files containing input_ids only. Split Size: 100k rows per file.

Source Compositions

HuggingFaceFW/finetranslations-edu (tur_Latn & tuk_Latn) Ba2han/dataset_repo (Wiki Cleaned) mlx-community/recycling_the_web-400K… See the full description on the dataset page: https://huggingface.co/datasets/Ba2han/tokenized-1202-2.