This is the benchmark for Library-based code generation task as part of the
BenchName benchmark.
The current version includes 150 manually curated instructions asking the model to generate Python code using a particular library.
The samples come from 62 Python repositories.
All the samples in the dataset are based on reference example programs written by authors of the respective libraries.
All the repositories are published under… See the full description on the dataset page:
https://huggingface.co/datasets/icmlbenchname/library-based-code-generation.
