You can deploy this model and start earning money today!

imdatta0/
qwen3-4b-swegym-top3gap-v1-control

Name: qwen3-4b-swegym-top3gap-v1-control
Availability: InStock

unsloth/Qwen3-4B-Instruct-2507

Views

No views yet

Qwen3-4B SWE-Gym Top3-Gap V1 Control Adapter

LoRA adapter checkpoint from the qwen3-grpo-patch SWE-Gym/Moto search-replace patching investigation.

This checkpoint is:

/mnt/disks/unslothai/datta0/cache/qwen3-grpo-patch/20260605_183122_swegym_q4b-kl02-sft20k-hardmulti-top3gap-v1-lr5e6_9a576cd/checkpoints/best_holdout

Base model:

unsloth/Qwen3-4B-Instruct-2507

Training

This is a conservative SFT continuation from the hard-multi frontier using top teacher-gap analog rows.

Training data:

runs/distill_hardmulti20k_plus_top3_teacher_gap_analogs_v1/sft_pass.jsonl

The continuation used 28 examples, 14 optimizer steps, and reached weighted mean loss 0.0407.

Evaluation

Recorded pass@8 run:

text

runs/passk_q4b_kl02_sft20k_hardmulti_top3gap_v1_lr5e6_20k_bf16_seed9012/summary.json

overall greedy pass@1: 8/35
selected@1:            11/35
overall pass@8:        12/35
single-file pass@8:    10/18
multi-file pass@8:     2/17

Interpretation: this continuation did not improve the frontier. It is useful as a negative/control checkpoint for the top teacher-gap analog SFT attempt.

imdatta0/qwen3-4b-swegym-top3gap-v1-control

Qwen3-4B SWE-Gym Top3-Gap V1 Control Adapter

Training

Evaluation

imdatta0/
qwen3-4b-swegym-top3gap-v1-control