Views
No views yet
finetuning/finetune.py.| Param | Value |
|---|---|
| LoRA r / alpha / dropout | 8 / 16 / 0.1 |
| Epochs | 3 |
| Learning rate | 0.0002 |
| Effective batch size | 1 x 16 = 16 |
| Max sequence length | 1024 |
| QLoRA (4-bit) | False |
| Trained | 20260715_173359 |
{instruction}
SAS:
{sas_code}
Python:1from transformers import AutoModelForCausalLM, AutoTokenizer
2
3model = AutoModelForCausalLM.from_pretrained("<this-repo-id>")
4tokenizer = AutoTokenizer.from_pretrained("<this-repo-id>")