You can deploy this model and start earning money today!

socius/
Smoltaur-0.1B-LoRA-r4

Name: Smoltaur-0.1B-LoRA-r4
Rating: 2.5 (21 reviews)

Views

No views yet

Hugging Face

socius

Paper

Smoltaur-0.1B-LoRA-r4

LoRA adapter for Smoltaur-0.1B, fine-tuned on the full Psych-101 as part of the LoRA-rank sweep and dataset-size ablation for Small Foundation Models of Human Cognition and Behaviour.

field	value
base model	unsloth/SmolLM2-135M
LoRA rank	4 (alpha = rank, rsLoRA)
data fraction	100% of Psych-101
training	1 epoch, completion-only loss, seed 3407

Load with PEFT on top of unsloth/SmolLM2-135M, or evaluate with the project's eval_model.py --backend unsloth.

socius/Smoltaur-0.1B-LoRA-r4

Smoltaur-0.1B-LoRA-r4

socius/
Smoltaur-0.1B-LoRA-r4