Beta

Explore
Marketplace
Neural Labs
Chat
Wallet
Docs

Beta

Explore Marketplace Neural Labs Wallet Docs

Build

Manage

My assets Manage wallet Organization

Community

Discord X (Twitter)Telegram

Docs Privacy Policy Terms and Conditions

Proud member of

Proud member of

Docs Cookie Policy

Privacy Policy Terms and Conditions

© 2026 AlphaNeural AI. All rights reserved.

dpo_gsm8k_qwen3-4b_as_llama-3.1-8b_seed1 – AI Model by dementor-research | AlphaNeural AI

You can deploy this model and start earning money today!

dementor-research/
dpo_gsm8k_qwen3-4b_as_llama-3.1-8b_seed1

like

0

dementor-research

Qwen/Qwen3-4B-Instruct-2507

Views

No views yet

dpo_gsm8k_qwen3-4b_as_llama-3.1-8b_seed1

LoRA adapter trained via Tinker as part of the dementor intervention-ladder fingerprint persistence study (AAAI 2026 conference).

Base model: Qwen/Qwen3-4B-Instruct-2507
Training stage: DPO (LoRA rank 32, target_modules=all-linear)
Alias: dpo_gsm8k_qwen3-4b_as_llama-3.1-8b_seed1

Usage

python

from peft import PeftModel
from transformers import AutoModelForCausalLM, AutoTokenizer

base = AutoModelForCausalLM.from_pretrained("Qwen/Qwen3-4B-Instruct-2507")
tok = AutoTokenizer.from_pretrained("Qwen/Qwen3-4B-Instruct-2507")
model = PeftModel.from_pretrained(base, "dementor-research/dpo_gsm8k_qwen3-4b_as_llama-3.1-8b_seed1")

Part of the dementor matrix: 4 source models × 3 cross-targets × 3 train datasets × 3 seeds × 2 stages = 216 adapters.