Views
No views yet

deepreinforce-ai/Ornith-1.0-35B — DeepReinforce's state-of-the-art agentic-coding MoE — with refusal behavior removed while preserving capability.Lineage note: the upstream card says the family is "post-trained on Gemma 4 and Qwen 3.5", but weight-correlation testing shows the 35B-MoE member is initialized fromQwen/Qwen3.6-35B-A3B(rel-L2 0.0022 vs 0.0256 to Qwen3.5-35B-A3B-Base). Architecture:qwen3_5_moe— 40 layers (30 GatedDeltaNet linear-attention + 10 full-attention), 256 routed experts + 1 shared (A3B), vision tower, 256K context.
conv1d outlier repair (FernflowerAI method) — rescaled 2 outlier blocks (layers 36/37, σ 0.10→0.062) before abliteration to prevent coherence collapse.abliterix v1.9: grimjim norm-preserving biprojected abliteration + Expert-Granular Abliteration (EGA) across all 256 fused experts + shared expert + router suppression, Optuna multi-objective search (refusals vs KL). Q/K/V left untouched (attn_output_gate). GatedDeltaNet/SSM internals and the vision tower are not modified.| Metric | Original Ornith-1.0-35B | This model |
|---|---|---|
| Refusals (80 diverse harmful prompts: CBRN, cyber, weapons, self-harm) | high | 0 / 80 (0.0%) |
| Agentic/coding pass@1 (18-task self-contained probe) | 0.833 | 0.833 (identical, family-by-family) |
| First-token KL vs base (abliteration fidelity) | — | ~0.0014 |
| Coherence (benign + harmful, long gen) | — | clean (no degeneration) |
1vllm serve AEON-7/Ornith-1.0-35B-AEON-Ultimate-Uncensored-BF16 \
2 --served-model-name ornith --max-model-len 262144 \
3 --gpu-memory-utilization 0.70 --max-num-batched-tokens 16384 \
4 --mamba-cache-dtype float32 \
5 --reasoning-parser qwen3 --enable-auto-tool-choice --tool-call-parser qwen3_coder \
6 --limit-mm-per-prompt '{"image":4,"video":2}' --mm-encoder-tp-mode data \
7 --attention-backend flash_attn \
8 --enable-chunked-prefill --enable-prefix-caching --trust-remote-code--served-model-name takes a list of aliases — name it after the model your clients already request for a drop-in cutover.
On the DGX Spark's unified memory keep --gpu-memory-utilization at 0.6-0.7; above ~0.8 the shared CPU+GPU pool page-thrashes. Discrete-VRAM GPUs can run higher.
Reasoning model: every turn opens <think>…</think>. Recommended sampling: temperature 0.6, top_p 0.95, top_k 20. Vision (image/video) is inherited from the base and intact; on a vision-enabled deploy, KV cache stays BF16.bc1q09xmzn00q4z3c5raene0f3pzn9d9pvawfm0py40x1512667F6D61454ad531d2E45C0a5d1fd82D0500DgQsjHdAnT5PNLQTNpJdpLS3tYGpVcsHQCkpoiAKsw8t836XrSKw4R76vNi3QPJ5Fa9ugcyvE2cWmKSPv3AhpTNNKvqP8v5ba9JRL4Vh7UnFNjDz3E2GXZDVVenu3rkZaNdUFhjAvgd