Created by the Syssec team @ UTD
Dataset Composition:
/data2/pypi: (train: 150000, test: 1000, valid: 1000)
/data2/csn: (train: 10000, test: 1000, valid: 1000)
Python version: 3.15
Dataset Statistics:
DatasetDict({
train: Dataset({
features: ['source', 'bytecode', 'boundary', 'file'],
num_rows: 2243299
})
test: Dataset({
features: ['source', 'bytecode', 'boundary', 'file'],
num_rows: 15534
})
valid:… See the full description on the dataset page:
https://huggingface.co/datasets/syssec-utd/segmentation-py315-pylingual-v4.
