Views
No views yet
unsloth/Qwen3.5-2B trained on PersonalFinance Extended data using Auto-SFT — an automated hyperparameter search and supervised fine-tuning pipeline.PersonalFinance Extended dataset. Expect improved performance on tasks similar to those represented in the training data.| Property | Value |
|---|---|
| Base model | unsloth/Qwen3.5-2B |
| Training data | data/PersonalFinance-Extended.json |
| Fine-tuning epochs | 1 |
| Fine-tuning date | 2026-07-26 |
| Fine-tuning method | LoRA (merged to full 16-bit) |
| Parameter | Value |
|---|---|
r | 64 |
alpha | 128 |
dropout | 0.02 |
target_modules | ['q_proj', 'v_proj'] |
| Parameter | Value |
|---|---|
learning_rate | 1e-05 |
batch_size | 1 |
gradient_accumulation_steps | 8 |
warmup_ratio | 0.1 |
max_seq_length | 512 |
quantization | none |
1from transformers import AutoModelForCausalLM, AutoTokenizer
2
3model = AutoModelForCausalLM.from_pretrained("theprint/Financial-v1-2B")
4tokenizer = AutoTokenizer.from_pretrained("theprint/Financial-v1-2B")