TwinkStart/

speech-triavia-qa

This dataset only contains test data, which is integrated into UltraEval-Audio(https://github.com/OpenBMB/UltraEval-Audio) framework.

python audio_evals/main.py --dataset speech-triviaqa --model gpt4o_speech

python audio_evals/main.py --dataset speech-triviaqa-s2t --model gpt4o_speech

UltraEval-Audio——全球首个同时支持语音理解和语音生成评估的开源框架，专为语音大模型评估打造，集合了34项权威Benchmark，覆盖语音、声音、医疗及音乐四大领域，支持十种语言，涵盖十二类任务。选择UltraEval-Audio，您将体验到前所未有的便捷与高效：

一键式基准管理… See the full description on the dataset page: https://huggingface.co/datasets/TwinkStart/speech-triavia-qa.