Tokey Pokey is a dataset designed to test the speed of tokenizers. It consists of:
Random sequences of English words
Random math-like expressions
Random Unicode characters below D7FF
Random printable ASCII characters
Random Arabic numerals
Random uppercase letters
Random lowercase letters
The dataset is shuffled.
