You input half finished python code, and it will generate python code.
Direct Use
Some level of fine tuning is likely needed or preferred. However I won't be working on this.
[More Information Needed]
Downstream Use [optional]
This can easily be used for IDEs. Not ideal though as it's rarely correct in its answer. Likely mainly attributed to how it's a pretty small model after all.
Even then, I'm already struggling to train it with my 4x Nvidia A100 PCIe 80GB, taking 15 hours!
How to Get Started with the Model
Use the code below to get started with the model.
just follow the instructions on huggingface "use this model". Should work. If not try and contact me.
[More Information Needed]
Training Details
Training Data
[More Information Needed]
Training Procedure
Preprocessing [optional]
[More Information Needed]
Training Hyperparameters
Training regime: [More Information Needed]
Speeds, Sizes, Times [optional]
111 million parameter. FP16, 444 Megabytes.
Pretty fast and lightweight model when using T4 GPU.
Perhaps not accurate because I'm expecting 1 to 1 representation for code. As in reality there's many way of coding to reach the same logic. And a precise way of coding is not required.
Results
1.1 loss/train in the end. Model converged after 150,000 steps.
