Is this your dataset? Claim it with the Hugging Face account that owns it.

FredyRivera-dev/
LLaDA-Sample-10BT

Name: LLaDA-Sample-10BT
Creator: FredyRivera-dev

text-generation

1B<n<10B

Views

No views yet

Dataset: LLaDA-Sample-10BTBase: HuggingFaceFW/fineweb (subset sample-10BT)Purpose: Training LLaDA (Large Language Diffusion Models)

Preprocessing

Tokenizer: GSAI-ML/LLaDA-8B-Instruct
Chunking: Up to 4,096 tokens per chunk (1% of chunks randomly sized between 1–4,096 tokens)
Noisy masking: Applied with noise factor ε = 1×10⁻³
Fields per chunk (PyTorch tensors):
input_ids
noisy_input_ids
mask
t (time scalar)

Statistics

Total chunks: ~2,520,000… See the full description on the dataset page: https://huggingface.co/datasets/FredyRivera-dev/LLaDA-Sample-10BT.