To create the dataset:
import os
import numpy as np
from datasets import load_dataset, DatasetDict, Dataset, Audio
import soundfile as sf
from tqdm import tqdm
tedlium = load_dataset("LIUM/tedlium", "release3")
merged_dataset = DatasetDict()
validation_speaker_ids = [
"Al_Gore",
"Barry_Schwartz",
"Blaise_Agueray_Arcas",
"Brian_Cox",
"Craig_Venter",
"David_Merrill",
"Elizabeth_Gilbert",
"Wade_Davis",
]… See the full description on the dataset page:
https://huggingface.co/datasets/distil-whisper/tedlium-long-form.