Shards are stored in parquet format.
It has 4 columns: serialized_latent, caption, fps, video.
serialized_latent is the latent vector of the video, serialized using torch.save().
Please use the following function to deserialize it:def deserialize_tensor(
serialized_tensor: bytes, device: Optional[str] = None
) -> torch.Tensor:
return torch.load(
io.BytesIO(serialized_tensor)… See the full description on the dataset page:
https://huggingface.co/datasets/fal/cosmos-openvid-1m.
