Complexity-1B
Model Details
Complexity-1B is a finetuned version of the GPT-NeoX 1.3B model [@gpt-neox] for code completion tasks. It was finetuned on a dataset of Python code from open source projects on GitHub.
Intended Uses
This model is intended to be used for code completion in Python. It can suggest likely completions for partially written Python code.
Evaluation Data
The model was evaluated on a holdout set from the training data distribution, containing Python code snippets.
Metrics
The primary evaluation metric was accuracy of code completion on the evaluation set. The model achieves 49% accuracy on code completion.
Ethical Considerations
The training data contains code from public GitHub repositories. Care should be taken to avoid completing code in unethical or harmful ways not intended by the original developers.
Caveats and Recommendations
The model is designed for Python code completion only. Performance on other programming languages is unknown. Users should carefully validate any generated code before executing or deploying it.
