You can deploy this model and start earning money today!

trixyL/
simplestories-8k-megatron

Views

No views yet

📦 Megatron-LM/MegaDLMs Preprocessed Dataset

This dataset hosts the Megatron-LM/MegaDLMs preprocessed SimpleStories dataset using an 8k vocab BPE Tokenizer.

✅ What this contains

Preprocessed Megatron dataset files (e.g., .bin / .idx) ready for Megatron-LM/MegaDLMs training BPE Tokenizer config files used to create the dataset

🔗 References

Fork with extra preprocessing utils for SimpleStories: https://github.com/triloy8/MegaDLMs Original MegaDLMs repo:… See the full description on the dataset page: https://huggingface.co/datasets/trixyL/simplestories-8k-megatron.