KleinWu/

llmsys-hpobench

LLMSYS-HPOBench is an offline benchmark dataset for hyperparameter optimization of real-world LLM systems. It covers inference engines, RAG pipelines, and agent frameworks, with normalized tabular measurements linked to log and hardware artifacts when available.

GitHub repository, benchmark loader, and contribution guide: https://github.com/ideas-labo/llmsys-hpobench Paper: https://arxiv.org/abs/2605.08305 Full data archive on… See the full description on the dataset page: https://huggingface.co/datasets/KleinWu/llmsys-hpobench.