Beta

Explore
Marketplace
Neural Labs
Chat
Models
Pricing
Wallet
Docs

Beta

Explore Marketplace Neural Labs Chat Models Pricing Wallet Docs

Build

Manage

My assets Manage wallet Organization

Community

Discord X (Twitter)Telegram

Models Pricing Docs Privacy Policy Terms and Conditions

Proud member of

Proud member of

Models Pricing Docs Cookie Policy

Privacy Policy Terms and Conditions

© 2026 AlphaNeural AI. All rights reserved.

dpo_gsm8k_gpt-oss-20b_as_qwen3.6-27b_seed2 – AI Model by dementor-research | AlphaNeural AI

You can deploy this model and start earning money today!

dementor-research/
dpo_gsm8k_gpt-oss-20b_as_qwen3.6-27b_seed2

like

0

dementor-research

openai/gpt-oss-20b

Views

No views yet

dpo_gsm8k_gpt-oss-20b_as_qwen3.6-27b_seed2

LoRA adapter trained via Tinker as part of the dementor intervention-ladder fingerprint persistence study (AAAI 2026 conference).

Base model: openai/gpt-oss-20b
Training stage: DPO (LoRA rank 32, target_modules=all-linear)
Alias: dpo_gsm8k_gpt-oss-20b_as_qwen3.6-27b_seed2

Usage

python

from peft import PeftModel
from transformers import AutoModelForCausalLM, AutoTokenizer

base = AutoModelForCausalLM.from_pretrained("openai/gpt-oss-20b")
tok = AutoTokenizer.from_pretrained("openai/gpt-oss-20b")
model = PeftModel.from_pretrained(base, "ethantsliu/dpo_gsm8k_gpt-oss-20b_as_qwen3.6-27b_seed2")

Part of the dementor matrix: 4 source models × 3 cross-targets × 3 train datasets × 3 seeds × 2 stages = 216 adapters.