Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
highex_l0-8_lowag_l18-26 – AI Model by collabo-research | AlphaNeural AI
You can deploy this model and start earning money today!
collabo-research
/
highex_l0-8_lowag_l18-26
like
0
peft
safetensors
lora
qwen3
enmlp-ablation
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
highex_l0-8_lowag_l18-26
Merged LoRA adapter produced for the EMNLP ablation study.
LoRA configuration
Base model:
unsloth/qwen3-8b-unsloth-bnb-4bit
r: 64
lora_alpha: 128
lora_dropout: 0.0
target_modules: ['gate_proj', 'v_proj', 'up_proj', 'k_proj', 'down_proj', 'o_proj', 'q_proj']
layers_to_transform: [0, 1, 2, 3, 4, 5, 6, 7, 8, 18, 19, 20, 21, 22, 23, 24, 25, 26]
