Dataset
Bytes
Samples
Capping
Unnatural Instructions
27M
66010
/
Big-Bench
1.7G
2631238
/
FLAN
3.1G
3354260
30K examples per dataset max with 10 templates total (So 3K / template)
SuperNatural-Instructions
7.4G
7101558
/
StackOverflow
9.0G
4730542
/
xP3-EN
37G
31495184
100K examples per data subset per prompt allowed (So 100K / template)
Total
58GB
49378792
