Views
No views yet
Qwen/Qwen3-Embedding-0.6B, merged back into the base at
α = 0.25 (WiSE-FT style interpolation), for one task: given a sentence a
writer is drafting, retrieve the note card (saved highlight) it draws on.model.safetensors is 1.1 GB, fp16, 1024-dim, Qwen3Model. Standard
SentenceTransformers layout — SentenceTransformer("<repo-id>") just works.| model | human-gold nDCG@10 | notes |
|---|---|---|
Octen/Octen-Embedding-0.6B (native prompt) | 0.3559 | frozen, Apache-2.0 |
Qwen/Qwen3-Embedding-0.6B (no prompt) | 0.3538 | frozen |
Octen/Octen-Embedding-0.6B (no prompt) | 0.3505 | frozen |
| this model (a025) | 0.3482 | |
| v2a (pure distill, unreleased) | 0.303 |
Instruct: ... query prefix. A prompt ablation found
it is net-negative for the base model; frozen base with no prompt is the best
number in the table above. If you use Octen, keep its native prompt.| operating point | base | octen | a025 |
|---|---|---|---|
| 40% of clause + context | 0.210 | 0.215 | 0.223 |
| 60% of clause + context | 0.257 | 0.272 | 0.285 |
| 100% clause, no context | 0.354 | 0.356 | 0.348 |
Qwen3-Reranker-4B
log-odds margins, LoRA r16/α32, then merged at α=0.25. The interpolation is what
made it survive out-of-domain; the pure-distill checkpoint (v2a, 0.303) is worse
than the base it started from.Octen/Octen-Embedding-0.6B frozen: tied-best
or better on both rulers, Apache-2.0, 600 MB, same backbone and MLX path, and no
LoRA-merge / prompt-calibration apparatus to maintain. Reach for this model only
if you are specifically working the mid-sentence regime and want to reproduce the
table above.a025-mlx in the source repo is a broken stub (the
safetensors entry is an 84-byte symlink). A Swift/MLX consumer needs a real
conversion first; mlx-community/Qwen3-Embedding-0.6B-4bit-DWQ is the only
ready-made MLX option today, and 4-bit was measured to cost nothing (device
goldset: 4-bit base 0.733 vs bf16 a025 0.730).