AutoSDT-5K is an automatically constructed dataset of 5,404 coding tasks for data-driven discovery that covers four scientific disciplines and 756 unique Python packages. Expert feedback on a subset of 256 tasks shows the quality of AutoSDT-5K: 93% of the collected tasks are ecologically valid, and 92.2% of the synthesized programs are functionally correct. To the best of our knowledge, AutoSDT-5K is the only… See the full description on the dataset page:
https://huggingface.co/datasets/osunlp/AutoSDT-5K.
