Created by the Syssec team @ UTD
Dataset Composition:
/data2/pypi: (train: 80000, test: 1000, valid: 1000)
/data2/csn: (train: 20000, test: 1000, valid: 1000)
Python version: 3.13
Dataset Statistics:
DatasetDict({
train: Dataset({
features: ['source', 'bytecode', 'boundary', 'file'],
num_rows: 1379851
})
test: Dataset({
features: ['source', 'bytecode', 'boundary', 'file'],
num_rows: 19118
})
valid: Dataset({… See the full description on the dataset page:
https://huggingface.co/datasets/syssec-utd/segmentation-py313-pylingual-v3.
