This model is a GPT-2 (124M parameter) causal language model trained from scratch specifically for Python code completion in Data Science contexts.
This model is an implementation of the GPT-2 architecture optimized for generating functional Python code snippets. It was trained using a custom training pipeline that incorporates a keytoken weighted loss function to prioritize important programming keywords (like plt, pd, fit, predict), making it more effective at suggesting Data Science-related code.
The model is intended to be used for code completion tasks, specifically for completing Python scripts involving libraries like pandas, matplotlib, and scikit-learn.
The model is not suitable for general-purpose natural language conversation or generating code in languages other than Python.
1from transformers import pipeline
2
3pipe = pipeline("text-generation", model="PranavGuhan/python-ds-accelerate")
4
5txt = """# create dataframe from x and y
6df = pd.DataFrame({'x':x, 'y':y})
7"""
8print(pipe(txt, num_return_sequences=1)[0]["generated_text"])
