FineVideo-Prototype-Tokenized — Base Video Token Dataset
Overview
This dataset contains the base video tokenization output from the prototype pipeline, extracted from ~40K YouTube videos in the FineVideo dataset.
Each video is tokenised into three modalities:
Seed2 — 1 FPS semantic keyframe tokens (vocab: 8,192)
Cosmos — every 8 frames spatial video tokens (vocab: 64,000)
AVC-LM — every 8 frames H.264 BPE tokens (vocab: 8,192)