HowToStep is an automatically generated, large-scale and high-quality dataset that transforms ASR transcripts into descriptive steps by prompting the LLM and then aligns steps to the video through a two-stage determination procedure.
[project page]
[Arxiv]
[GitHub]
HowToStep transforms the original transcripts of HTM-370K into around 4M ordered instructional steps with start/end timestamps for almost 340K videos after filtering.
As shown in figure… See the full description on the dataset page:
https://huggingface.co/datasets/zeqianli/HowToStep.