You can deploy this model and start earning money today!

amine-khelif/
LoRA_Qwen3-4B-Thinking-2507_from_base

Name: LoRA_Qwen3-4B-Thinking-2507_from_base
Availability: InStock

safetensors

Views

No views yet

Qwen3 LoRA Adapters Collection

Collection of LoRA adapters extracted from Qwen/Qwen3-4B-Thinking-2507 using different rank and epsilon parameters.

Structure

adapters/
├── rank8_eps0.01/
├── rank8_eps0.1/
├── rank16_eps0.01/
└── ...

Usage

python

from peft import PeftModel
from transformers import AutoModelForCausalLM

# Load base model
base_model = AutoModelForCausalLM.from_pretrained("Qwen/Qwen3-4B-Base")

# Apply specific LoRA adapter
lora_model = PeftModel.from_pretrained(base_model, "adapters/rank16_eps0.10")

Parameter Guide

Rank: Lower = more efficient, Higher = potentially better quality
Epsilon: Threshold for singular value filtering (lower = more components kept)

amine-khelif/LoRA_Qwen3-4B-Thinking-2507_from_base

Qwen3 LoRA Adapters Collection

Structure

Usage

Parameter Guide

amine-khelif/
LoRA_Qwen3-4B-Thinking-2507_from_base