Views
No views yet
chimingw/Qwen3.8-27B-Uncensored-OrcaRouter-GGUForcarouter/Qwen3.8-27B-Uncensored-GGUF@402c3e0a64d77880f55ab096c5b7597ef85162ab. It was not transcoded from another quant and does not use the older FP8-expanded BF16 working representation. This conversion adds no training, fine-tuning, merging, or alignment change.An abliterated (refusal-removed) build of Qwen/Qwen3.8-27B, a dense native vision-language model with an MTP speculative-decoding head.⚠️ Disclaimer — read before useThis model has had its safety alignment substantially removed via abliteration (orthogonalizing the refusal direction out of the residual stream). As a direct consequence:
- It will comply with harmful, unethical, offensive, or illegal requests that the original Qwen3.8-27B would refuse. It has no meaningful built-in guardrails.
- It is released strictly for legitimate research — interpretability, AI-safety and refusal-mechanism study, red-teaming, robustness evaluation, and controlled experiments.
- You assume full responsibility and liability for how you use it and for everything it generates. Do not deploy it to end users or in production without adding your own safety, moderation, and abuse-prevention layers.
- Use must comply with the Apache 2.0 License inherited from the base model, and all laws and regulations that apply to you.
- The authors and uploaders accept no liability for any misuse or harm arising from this model. Its outputs do not reflect the views of the uploaders or of Qwen / Alibaba.
By downloading or using this model you acknowledge and accept the above.
orcarouter/Qwen3.8-27B-Uncensored-GGUF@402c3e0a64d77880f55ab096c5b7597ef85162ab, two F16 GGUF shards plus mmproj-Qwen3.8-27B-Uncensored-f16.gguf.mtp.fc.weight sample was exactly the old BF16 values stored as F16. A sampled vision-projector BF16 matrix was byte-identical to the old source-derived BF16 matrix despite the new projector's f16 filename. The projector's two distinct GGUF patch-embedding tensors are ordered temporal slices; both are stacked before the native MLX channels-last transpose, reconciling 334 physical mmproj tensors to 333 native vision tensors without dropping either slice. These audits establish precision lineage, not an intelligence gain.1Qwen/Qwen3.8-27B
2└── orcarouter/Qwen3.8-27B-Uncensored-GGUF@402c3e0a64d77880f55ab096c5b7597ef85162ab (F16 parent)
3 └── chimingw/Qwen3.8-27B-Uncensored-OrcaRouter-MLX-6bitThe recursively validated package contains 1199 logical tensors: 504 eligible matrices encoded as native MLX affine 6-bit/group-64 weights, and 695 dense tensors retained in their source-derived F16/BF16/F32 contract. The package contains 2207 physical tensors totaling 24,696,138,240 tensor-payload bytes. must be replaced with the final recursively validated counts. The required M4 Pro gates exercise this mixed F16/BF16/F32 package.| File | Bytes | SHA-256 |
|---|---|---|
| Qwen3.8-27B-Uncensored-F16-00001-of-00002.gguf | 27,908,108,288 | 578926d4e6d94281e95a48d8e154c4667061a669e9016f2aa2b15101ab4363dc |
| Qwen3.8-27B-Uncensored-F16-00002-of-00002.gguf | 26,749,625,920 | c15e78454caec46b19dae22fa6915a9e77b917e7cceffdc64c265801f4eaa1f1 |
| mmproj-Qwen3.8-27B-Uncensored-f16.gguf | 931,145,984 | add205b7bfdb3f71f6da36b0a82aa20928dd829a920878c602628cdfbebc5288 |
| File | Bytes | SHA-256 |
|---|---|---|
| model-00001-of-00006.safetensors | 4,881,450,312 | 232e337b6d0c43020a3c683cd19c78c6da43e5fe49b3e0f8a013bc64c42d68d2 |
| model-00002-of-00006.safetensors | 4,888,278,624 | 6ac0427c57151bd18d5dfc1ea1ea402237c129d363a5205fd0ef8e59cc8edf3a |
| model-00003-of-00006.safetensors | 4,866,460,760 | 88eda786c0ce5e457d08303b570a1098fff550e915709fe87e18d2703ad4b090 |
| model-00004-of-00006.safetensors | 4,862,719,120 | a68342493c0ff867567d93b9b360c5cd6df59315f5c4f0bbfbb7538beb5abc71 |
| model-00005-of-00006.safetensors | 4,896,255,808 | eef39ce12cfd07b1e3d0822b28c27a930a029309df1955c7d6812ab7d548de28 |
| model-00006-of-00006.safetensors | 301,255,064 | 19fd59c98dac824a8bce6dcc921aee6c6107dae16f7edcdc3c52d077b6ce71fa |
/workspace/orcarouter-f16/work/release/MLX-6bit/ARTIFACT-MANIFEST.json — d272451c9674f2bf9249e64aec08a3a4c8a753ee711002518744aeab8819573e.mlx-serve-26.8.7|mlx-0.32.0|mlx-c-fba4470b8907|llama.cpp-b10034. Text determinism, chat-template tool calling, image-grounded vision (red), and clean unload all passed. MTP-off produced zero draft tokens in 11.689557s; MTP-on drafted 66 tokens and accepted 66 in 7.029308s. The matched output SHA-256 was 65966537023045093dda6a4bf49057afef35319d2f5170c68435d3330c8cec10 in both modes. Durations are bounded smoke-test evidence, not performance benchmarks.| Model | Perplexity | Tokens |
|---|---|---|
| old-fp8-derived-Q4_K_M | 5.8034 | 2048 |
| new-f16-derived-Q4_K_M | 5.7962 | 2048 |
| old-fp8-derived-Q5_K_M | 5.7901 | 2048 |
| new-f16-derived-Q5_K_M | 5.7774 | 2048 |
| old-fp8-derived-Q6_K | 5.8586 | 2048 |
| new-f16-derived-Q6_K | 5.8034 | 2048 |
| old-fp8-derived-Q8_0 | 5.7958 | 2048 |
| new-f16-derived-Q8_0 | 5.8195 | 2048 |
/workspace/orcarouter-f16/work/fidelity-v2/FIDELITY-REPORT.json — 9774c9205abac6feb2ff8759627dc5b2087e703d7141f42a658432a92de02e0d.1{
2 "artifacts": {
3 "model-00001-of-00006.safetensors": {
4 "sha256": "232e337b6d0c43020a3c683cd19c78c6da43e5fe49b3e0f8a013bc64c42d68d2",
5 "size": 4881450312
6 },
7 "model-00002-of-00006.safetensors": {
8 "sha256": "6ac0427c57151bd18d5dfc1ea1ea402237c129d363a5205fd0ef8e59cc8edf3a",
9 "size": 4888278624
10 },
11 "model-00003-of-00006.safetensors": {
12 "sha256": "88eda786c0ce5e457d08303b570a1098fff550e915709fe87e18d2703ad4b090",
13 "size": 4866460760
14 },
15 "model-00004-of-00006.safetensors": {
16 "sha256": "a68342493c0ff867567d93b9b360c5cd6df59315f5c4f0bbfbb7538beb5abc71",
17 "size": 4862719120
18 },
19 "model-00005-of-00006.safetensors": {
20 "sha256": "eef39ce12cfd07b1e3d0822b28c27a930a029309df1955c7d6812ab7d548de28",
21 "size": 4896255808
22 },
23 "model-00006-of-00006.safetensors": {
24 "sha256": "19fd59c98dac824a8bce6dcc921aee6c6107dae16f7edcdc3c52d077b6ce71fa",
25 "size": 301255064
26 }
27 },
28 "fidelity": {
29 "corpus": {
30 "path": "wikitext-2-raw/wiki.test.raw",
31 "sha256": "173c87a53759e0201f33e0ccf978e510c2042d7f2cb78229d9a50d79b9e7dd08",
32 "size": 1290590
33 },
34 "report": {
35 "path": "/workspace/orcarouter-f16/work/fidelity-v2/FIDELITY-REPORT.json",
36 "sha256": "9774c9205abac6feb2ff8759627dc5b2087e703d7141f42a658432a92de02e0d",
37 "size": 17333
38 },
39 "results": [
40 {
41 "label": "old-fp8-derived-Q4_K_M",
42 "perplexity": 5.8034,
43 "token_count": 2048
44 },
45 {
46 "label": "new-f16-derived-Q4_K_M",
47 "perplexity": 5.7962,
48 "token_count": 2048
49 },
50 {
51 "label": "old-fp8-derived-Q5_K_M",
52 "perplexity": 5.7901,
53 "token_count": 2048
54 },
55 {
56 "label": "new-f16-derived-Q5_K_M",
57 "perplexity": 5.7774,
58 "token_count": 2048
59 },
60 {
61 "label": "old-fp8-derived-Q6_K",
62 "perplexity": 5.8586,
63 "token_count": 2048
64 },
65 {
66 "label": "new-f16-derived-Q6_K",
67 "perplexity": 5.8034,
68 "token_count": 2048
69 },
70 {
71 "label": "old-fp8-derived-Q8_0",
72 "perplexity": 5.7958,
73 "token_count": 2048
74 },
75 {
76 "label": "new-f16-derived-Q8_0",
77 "perplexity": 5.8195,
78 "token_count": 2048
79 }
80 ]
81 },
82 "kind": "mlx",
83 "mlx": {
84 "bits": 6,
85 "bits_passed": [
86 4,
87 5,
88 6,
89 8
90 ],
91 "conversion_report": {
92 "path": "/workspace/orcarouter-f16/work/state/mlx-conversion-runtime.json",
93 "sha256": "649cd87ca10216f9743640de5f18ae7c42767efaca8e4e4f851fad5d46470092",
94 "size": 1024
95 },
96 "dequantize_passed": true,
97 "group_size": 64,
98 "m4_runtime_passed": true,
99 "mode": "affine",
100 "quantize_passed": true
101 },
102 "runtime": {
103 "gates": {
104 "deterministic": {
105 "passed": true,
106 "run_1_output_sha256": "2f2d059139883d9985ea4178113bf6ac4fa731a1b72ab0be2608a3a279411144",
107 "run_2_output_sha256": "2f2d059139883d9985ea4178113bf6ac4fa731a1b72ab0be2608a3a279411144"
108 },
109 "mtp_off": {
110 "draft_tokens": 0,
111 "mtp_weights_loaded": true,
112 "passed": true,
113 "speculative_decoding_enabled": false
114 },
115 "mtp_on": {
116 "draft_tokens": 66,
117 "mtp_weights_loaded": true,
118 "passed": true,
119 "speculative_decoding_enabled": true
120 },
121 "text": {
122 "passed": true
123 },
124 "tool": {
125 "passed": true
126 },
127 "vision": {
128 "passed": true
129 }
130 },
131 "hardware": {
132 "macOS": "26.6.1",
133 "memory_GiB": 48,
134 "model": "Mac M4 Pro"
135 },
136 "report": {
137 "path": "/workspace/orcarouter-f16/work/runtime-mlx/MLX-6bit/attestation.rebased.json",
138 "sha256": "900f8a09717a1beac4c23810056fd465e6fe9646cd52a4d099240888fcb6423b",
139 "size": 9979
140 },
141 "revision": "mlx-serve-26.8.7|mlx-0.32.0|mlx-c-fba4470b8907|llama.cpp-b10034"
142 },
143 "schema": 1,
144 "source": {
145 "files": [
146 {
147 "path": "Qwen3.8-27B-Uncensored-F16-00001-of-00002.gguf",
148 "sha256": "578926d4e6d94281e95a48d8e154c4667061a669e9016f2aa2b15101ab4363dc",
149 "size": 27908108288
150 },
151 {
152 "path": "Qwen3.8-27B-Uncensored-F16-00002-of-00002.gguf",
153 "sha256": "c15e78454caec46b19dae22fa6915a9e77b917e7cceffdc64c265801f4eaa1f1",
154 "size": 26749625920
155 },
156 {
157 "path": "mmproj-Qwen3.8-27B-Uncensored-f16.gguf",
158 "sha256": "add205b7bfdb3f71f6da36b0a82aa20928dd829a920878c602628cdfbebc5288",
159 "size": 931145984
160 }
161 ],
162 "repo": "orcarouter/Qwen3.8-27B-Uncensored-GGUF",
163 "revision": "402c3e0a64d77880f55ab096c5b7597ef85162ab"
164 }
165}