Views
No views yet
| Item | Value |
|---|---|
| Base Model | unsloth/medgemma-1.5-4b-it |
| Domain | Oncology |
| Task | Lung Cancer Risk Prediction |
| Finetuning Method | LoRA |
| Developer | Phiphi216 |
| License | Apache 2.0 |
1{
2 "lung_cancer_risk": "Cancer within follow-up"
3}1unsloth/medgemma-1.5-4b-it
21r: 16
2lora_alpha: 16
3lora_dropout: 0.0
4
5finetune_vision_layers: false
6finetune_language_layers: true
7
8finetune_attention_modules: true
9finetune_mlp_modules: true
10
11optimizer: adamw_torch_fused
12
13learning_rate: 2e-4
14
15weight_decay: 1e-3
16
17lr_scheduler_type: cosine
18
19max_grad_norm: 0.3
20
21per_device_train_batch_size: 2
22
23gradient_accumulation_steps: 2
24
25effective_batch_size: 4
26
27max_seq_length: 25808
28
29max_steps: 125
30
31warmup_ratio: 0