This is the benchmark for Module summarization task as part of the
🥷 BenchName benchmark.
The current version includes 216 manually curated text files describing different documentation of open-source permissive Python projects.
The model is required to generate such description, given the relevant context code and the intent behind the documentation.
All the repositories are published under permissive licenses (MIT, Apache-2.0, BSD-3-Clause… See the full description on the dataset page:
https://huggingface.co/datasets/anon-iclr-submission/benchname-module-summarization.