As datasets puts limits on the number of calls to huggingface, downloading SlimPajama-627B is problematic as it's composed of a ton of small files.
I have reuploaded it here as larger chunks to easily download the dataset without having to do anything hacky.
The original dataset can be found here
https://huggingface.co/datasets/cerebras/SlimPajama-627B
