Views
No views yet
LGAI-EXAONE/EXAONE-3.5-7.8B-Instruct| Parameter | Value |
|---|---|
Rank (r) | 16 |
| Alpha | 32 |
| Dropout | 0.05 |
| Bias | none |
| Task Type | CAUSAL_LM |
| Target Modules | q_proj, k_proj |
| Argument | Value |
|---|---|
| Per device train batch size | 8 |
| Gradient accumulation steps | 1 |
| Epochs | 3 |
| Learning rate | 5e-6 |
| Weight decay | 0.1 |