Views
No views yet
chimingw/Qwen3.8-27B-Uncensored-OrcaRouter-GGUForcarouter/Qwen3.8-27B-Uncensored-GGUF@402c3e0a64d77880f55ab096c5b7597ef85162ab. It was not transcoded from another quant and does not use the older FP8-expanded BF16 working representation. This conversion adds no training, fine-tuning, merging, or alignment change.An abliterated (refusal-removed) build of Qwen/Qwen3.8-27B, a dense native vision-language model with an MTP speculative-decoding head.⚠️ Disclaimer — read before useThis model has had its safety alignment substantially removed via abliteration (orthogonalizing the refusal direction out of the residual stream). As a direct consequence:
- It will comply with harmful, unethical, offensive, or illegal requests that the original Qwen3.8-27B would refuse. It has no meaningful built-in guardrails.
- It is released strictly for legitimate research — interpretability, AI-safety and refusal-mechanism study, red-teaming, robustness evaluation, and controlled experiments.
- You assume full responsibility and liability for how you use it and for everything it generates. Do not deploy it to end users or in production without adding your own safety, moderation, and abuse-prevention layers.
- Use must comply with the Apache 2.0 License inherited from the base model, and all laws and regulations that apply to you.
- The authors and uploaders accept no liability for any misuse or harm arising from this model. Its outputs do not reflect the views of the uploaders or of Qwen / Alibaba.
By downloading or using this model you acknowledge and accept the above.
orcarouter/Qwen3.8-27B-Uncensored-GGUF@402c3e0a64d77880f55ab096c5b7597ef85162ab, two F16 GGUF shards plus mmproj-Qwen3.8-27B-Uncensored-f16.gguf.mtp.fc.weight sample was exactly the old BF16 values stored as F16. A sampled vision-projector BF16 matrix was byte-identical to the old source-derived BF16 matrix despite the new projector's f16 filename. The projector's two distinct GGUF patch-embedding tensors are ordered temporal slices; both are stacked before the native MLX channels-last transpose, reconciling 334 physical mmproj tensors to 333 native vision tensors without dropping either slice. These audits establish precision lineage, not an intelligence gain.1Qwen/Qwen3.8-27B
2└── orcarouter/Qwen3.8-27B-Uncensored-GGUF@402c3e0a64d77880f55ab096c5b7597ef85162ab (F16 parent)
3 └── chimingw/Qwen3.8-27B-Uncensored-OrcaRouter-MLX-8bitThe recursively validated package contains 1199 logical tensors: 504 eligible matrices encoded as native MLX affine 8-bit/group-64 weights, and 695 dense tensors retained in their source-derived F16/BF16/F32 contract. The package contains 2207 physical tensors totaling 31,194,688,000 tensor-payload bytes. must be replaced with the final recursively validated counts. The required M4 Pro gates exercise this mixed F16/BF16/F32 package.| File | Bytes | SHA-256 |
|---|---|---|
| Qwen3.8-27B-Uncensored-F16-00001-of-00002.gguf | 27,908,108,288 | 578926d4e6d94281e95a48d8e154c4667061a669e9016f2aa2b15101ab4363dc |
| Qwen3.8-27B-Uncensored-F16-00002-of-00002.gguf | 26,749,625,920 | c15e78454caec46b19dae22fa6915a9e77b917e7cceffdc64c265801f4eaa1f1 |
| mmproj-Qwen3.8-27B-Uncensored-f16.gguf | 931,145,984 | add205b7bfdb3f71f6da36b0a82aa20928dd829a920878c602628cdfbebc5288 |
| File | Bytes | SHA-256 |
|---|---|---|
| model-00001-of-00007.safetensors | 4,831,439,056 | 95b2538f7521ec1912a6ae7e33748f3d4dd615daa3e8270ed95ed0dec3b63498 |
| model-00002-of-00007.safetensors | 4,852,372,272 | d6f2feec87c865e400fc5abb60d4cb54ea803e0376661cb3bff2653aa3b2ddbb |
| model-00003-of-00007.safetensors | 4,840,627,800 | 818a342a50927634d8433fbfd78944acb86c50d5c475e5918de2e955863c092d |
| model-00004-of-00007.safetensors | 4,835,657,096 | f12e8c23e9a0cbde62b979f7d6d253d292cf4dad100fef8682b96be78914832c |
| model-00005-of-00007.safetensors | 4,880,831,896 | 98ea59f0a17fada1177c5d38c446ca83d474be68b77d585653a99d849bcd7eae |
| model-00006-of-00007.safetensors | 4,840,627,360 | d315b7aab32c87095a36ec98357c8649386add5511fb2e0fd8e6a7c6e3162176 |
| model-00007-of-00007.safetensors | 2,113,414,640 | dc5323be49315c5d471153e4ef6990a7364a35f284b67263c46de444112e954a |
/workspace/orcarouter-f16/work/release/MLX-8bit/ARTIFACT-MANIFEST.json — e0be3703ec68d3d5776a76b2e32fc7a17f20c76fdc687c2186aff997f394c8fc.mlx-serve-26.8.7|mlx-0.32.0|mlx-c-fba4470b8907|llama.cpp-b10034. Text determinism, chat-template tool calling, image-grounded vision (red), and clean unload all passed. MTP-off produced zero draft tokens in 13.868492s; MTP-on drafted 66 tokens and accepted 66 in 6.695466s. The matched output SHA-256 was 65966537023045093dda6a4bf49057afef35319d2f5170c68435d3330c8cec10 in both modes. Durations are bounded smoke-test evidence, not performance benchmarks.| Model | Perplexity | Tokens |
|---|---|---|
| old-fp8-derived-Q4_K_M | 5.8034 | 2048 |
| new-f16-derived-Q4_K_M | 5.7962 | 2048 |
| old-fp8-derived-Q5_K_M | 5.7901 | 2048 |
| new-f16-derived-Q5_K_M | 5.7774 | 2048 |
| old-fp8-derived-Q6_K | 5.8586 | 2048 |
| new-f16-derived-Q6_K | 5.8034 | 2048 |
| old-fp8-derived-Q8_0 | 5.7958 | 2048 |
| new-f16-derived-Q8_0 | 5.8195 | 2048 |
/workspace/orcarouter-f16/work/fidelity-v2/FIDELITY-REPORT.json — 9774c9205abac6feb2ff8759627dc5b2087e703d7141f42a658432a92de02e0d.1{
2 "artifacts": {
3 "model-00001-of-00007.safetensors": {
4 "sha256": "95b2538f7521ec1912a6ae7e33748f3d4dd615daa3e8270ed95ed0dec3b63498",
5 "size": 4831439056
6 },
7 "model-00002-of-00007.safetensors": {
8 "sha256": "d6f2feec87c865e400fc5abb60d4cb54ea803e0376661cb3bff2653aa3b2ddbb",
9 "size": 4852372272
10 },
11 "model-00003-of-00007.safetensors": {
12 "sha256": "818a342a50927634d8433fbfd78944acb86c50d5c475e5918de2e955863c092d",
13 "size": 4840627800
14 },
15 "model-00004-of-00007.safetensors": {
16 "sha256": "f12e8c23e9a0cbde62b979f7d6d253d292cf4dad100fef8682b96be78914832c",
17 "size": 4835657096
18 },
19 "model-00005-of-00007.safetensors": {
20 "sha256": "98ea59f0a17fada1177c5d38c446ca83d474be68b77d585653a99d849bcd7eae",
21 "size": 4880831896
22 },
23 "model-00006-of-00007.safetensors": {
24 "sha256": "d315b7aab32c87095a36ec98357c8649386add5511fb2e0fd8e6a7c6e3162176",
25 "size": 4840627360
26 },
27 "model-00007-of-00007.safetensors": {
28 "sha256": "dc5323be49315c5d471153e4ef6990a7364a35f284b67263c46de444112e954a",
29 "size": 2113414640
30 }
31 },
32 "fidelity": {
33 "corpus": {
34 "path": "wikitext-2-raw/wiki.test.raw",
35 "sha256": "173c87a53759e0201f33e0ccf978e510c2042d7f2cb78229d9a50d79b9e7dd08",
36 "size": 1290590
37 },
38 "report": {
39 "path": "/workspace/orcarouter-f16/work/fidelity-v2/FIDELITY-REPORT.json",
40 "sha256": "9774c9205abac6feb2ff8759627dc5b2087e703d7141f42a658432a92de02e0d",
41 "size": 17333
42 },
43 "results": [
44 {
45 "label": "old-fp8-derived-Q4_K_M",
46 "perplexity": 5.8034,
47 "token_count": 2048
48 },
49 {
50 "label": "new-f16-derived-Q4_K_M",
51 "perplexity": 5.7962,
52 "token_count": 2048
53 },
54 {
55 "label": "old-fp8-derived-Q5_K_M",
56 "perplexity": 5.7901,
57 "token_count": 2048
58 },
59 {
60 "label": "new-f16-derived-Q5_K_M",
61 "perplexity": 5.7774,
62 "token_count": 2048
63 },
64 {
65 "label": "old-fp8-derived-Q6_K",
66 "perplexity": 5.8586,
67 "token_count": 2048
68 },
69 {
70 "label": "new-f16-derived-Q6_K",
71 "perplexity": 5.8034,
72 "token_count": 2048
73 },
74 {
75 "label": "old-fp8-derived-Q8_0",
76 "perplexity": 5.7958,
77 "token_count": 2048
78 },
79 {
80 "label": "new-f16-derived-Q8_0",
81 "perplexity": 5.8195,
82 "token_count": 2048
83 }
84 ]
85 },
86 "kind": "mlx",
87 "mlx": {
88 "bits": 8,
89 "bits_passed": [
90 4,
91 5,
92 6,
93 8
94 ],
95 "conversion_report": {
96 "path": "/workspace/orcarouter-f16/work/state/mlx-conversion-runtime.json",
97 "sha256": "649cd87ca10216f9743640de5f18ae7c42767efaca8e4e4f851fad5d46470092",
98 "size": 1024
99 },
100 "dequantize_passed": true,
101 "group_size": 64,
102 "m4_runtime_passed": true,
103 "mode": "affine",
104 "quantize_passed": true
105 },
106 "runtime": {
107 "gates": {
108 "deterministic": {
109 "passed": true,
110 "run_1_output_sha256": "2f2d059139883d9985ea4178113bf6ac4fa731a1b72ab0be2608a3a279411144",
111 "run_2_output_sha256": "2f2d059139883d9985ea4178113bf6ac4fa731a1b72ab0be2608a3a279411144"
112 },
113 "mtp_off": {
114 "draft_tokens": 0,
115 "mtp_weights_loaded": true,
116 "passed": true,
117 "speculative_decoding_enabled": false
118 },
119 "mtp_on": {
120 "draft_tokens": 66,
121 "mtp_weights_loaded": true,
122 "passed": true,
123 "speculative_decoding_enabled": true
124 },
125 "text": {
126 "passed": true
127 },
128 "tool": {
129 "passed": true
130 },
131 "vision": {
132 "passed": true
133 }
134 },
135 "hardware": {
136 "macOS": "26.6.1",
137 "memory_GiB": 48,
138 "model": "Mac M4 Pro"
139 },
140 "report": {
141 "path": "/workspace/orcarouter-f16/work/runtime-mlx/MLX-8bit/attestation.rebased.json",
142 "sha256": "4e56600f7b8b91f38a98402ee9d48d2f2e2bcf7606337b35dd70a15e643f90df",
143 "size": 10091
144 },
145 "revision": "mlx-serve-26.8.7|mlx-0.32.0|mlx-c-fba4470b8907|llama.cpp-b10034"
146 },
147 "schema": 1,
148 "source": {
149 "files": [
150 {
151 "path": "Qwen3.8-27B-Uncensored-F16-00001-of-00002.gguf",
152 "sha256": "578926d4e6d94281e95a48d8e154c4667061a669e9016f2aa2b15101ab4363dc",
153 "size": 27908108288
154 },
155 {
156 "path": "Qwen3.8-27B-Uncensored-F16-00002-of-00002.gguf",
157 "sha256": "c15e78454caec46b19dae22fa6915a9e77b917e7cceffdc64c265801f4eaa1f1",
158 "size": 26749625920
159 },
160 {
161 "path": "mmproj-Qwen3.8-27B-Uncensored-f16.gguf",
162 "sha256": "add205b7bfdb3f71f6da36b0a82aa20928dd829a920878c602628cdfbebc5288",
163 "size": 931145984
164 }
165 ],
166 "repo": "orcarouter/Qwen3.8-27B-Uncensored-GGUF",
167 "revision": "402c3e0a64d77880f55ab096c5b7597ef85162ab"
168 }
169}