Beta

Explore
Marketplace
Neural Labs
Chat
Wallet
Docs

Beta

Explore Marketplace Neural Labs Wallet Docs

Build

Manage

My assets Manage wallet Organization

Community

Discord X (Twitter)Telegram

Docs Privacy Policy Terms and Conditions

Proud member of

Proud member of

Docs Cookie Policy

Privacy Policy Terms and Conditions

© 2026 AlphaNeural AI. All rights reserved.

Qwen3-8B-lora-tulu-sft – AI Model by JerrySiRi | AlphaNeural AI

You can deploy this model and start earning money today!

JerrySiRi/
Qwen3-8B-lora-tulu-sft

like

0

Views

No views yet

qwen3-8B-32-64-5k

PEFT LoRA adapter fine-tuned from Qwen/Qwen3-8B on rl-research/dr-tulu-sft-data.

Training Details

LoRA rank: 32, alpha: 64
Target modules: q_proj, v_proj, k_proj, up_proj, down_proj, gate_proj, o_proj
Trained with LlamaFactory on 2x GPUs, 3 epochs, cosine LR schedule.

Usage

python

from peft import PeftModel
from transformers import AutoModelForCausalLM, AutoTokenizer

base_model_id = "Qwen/Qwen3-8B"
base = AutoModelForCausalLM.from_pretrained(base_model_id, torch_dtype="auto", device_map="auto")
tokenizer = AutoTokenizer.from_pretrained(base_model_id)
model = PeftModel.from_pretrained(base, "qwen3-8B-32-64-5k")