Generated with qwen_continuation_dataset.
ds = load_dataset("TeoStarshine/batch_test_entropy")
ds = load_dataset("TeoStarshine/batch_test_entropy", streaming=True)
source_name
source dataset (fineweb /… See the full description on the dataset page:
https://huggingface.co/datasets/TeoStarshine/batch_test_entropy.