autoiac-project/

iac-eval

IaC-Eval dataset is the first human-curated and challenging Cloud Infrastructure-as-Code (IaC) dataset tailored to more rigorously benchmark large language models' IaC code generation capabilities. This dataset contains 458 questions ranging from simple to difficult across various cloud services (targeting AWS for now). | Github | 🏆 Leaderboard TBD | 📖 NeurIPS 2024 Paper |

	2. Usage instructions






	Option 1: Running the evaluation… See the full description on the dataset page: https://huggingface.co/datasets/autoiac-project/iac-eval.