You can deploy this model and start earning money today!

socius/
Olmotaur-7B-LoRA-r8

Name: Olmotaur-7B-LoRA-r8
Rating: 2.5 (19 reviews)

allenai/Olmo-3-1025-7B

adapter

apache-2.0

Views

No views yet

AI2

socius

Paper

Olmotaur-7B-LoRA-r8

LoRA adapter for Olmotaur-7B, fine-tuned on the full Psych-101 as part of the LoRA-rank sweep and dataset-size ablation for Small Foundation Models of Human Cognition and Behaviour.

field	value
base model	allenai/Olmo-3-1025-7B
LoRA rank	8 (alpha = rank, rsLoRA)
data fraction	100% of Psych-101
training	1 epoch, completion-only loss, seed 3407

Load with PEFT on top of allenai/Olmo-3-1025-7B, or evaluate with the project's eval_model.py --backend unsloth.

socius/Olmotaur-7B-LoRA-r8

Olmotaur-7B-LoRA-r8

socius/
Olmotaur-7B-LoRA-r8