Run this once to fetch the parquet files and videos, and save them in a load_from_disk-compatible format:
from huggingface_hub import snapshot_download
from datasets import load_dataset
LOCAL_DIR = "challenge-dataset"
1. Download everything (parquet and video folders) into one local directory