Released as part of the NOESIS Professional Multilingual Dubbing Automation Platform (framework: DHCF-FNO — Deterministic Hybrid Control Framework for Frozen Neural Operators).

Founder: Ilia Bolotnikov
Organization: AMAImedia.com
X (Twitter): @AMAImediacom
LinkedIn: Ilia Bolotnikov
Telegram: @djbionicl
NOESIS version: v16.1
Release date: 2026-08-26

Language support

This Qwen3.5-derived model follows the official Qwen3 language list below (119 languages and dialects) and the official Qwen3.5 coverage statement of 201 languages and dialects. Qwen3.5 publishes the expanded coverage count but does not provide an exhaustive 201-name enumeration in its model card. The list below is the complete language list published by Qwen for Qwen3 and is included as the transparent, documented baseline for this derivative.

English, French, Portuguese, German, Romanian, Swedish, Danish, Bulgarian, Russian, Czech, Greek, Ukrainian, Spanish, Dutch, Slovak, Croatian, Polish, Lithuanian, Norwegian Bokmål, Norwegian Nynorsk, Persian, Slovenian, Gujarati, Latvian, Italian, Occitan, Nepali, Marathi, Belarusian, Serbian, Luxembourgish, Venetian, Assamese, Welsh, Silesian, Asturian, Chhattisgarhi, Awadhi, Maithili, Bhojpuri, Sindhi, Irish, Faroese, Hindi, Punjabi, Bengali, Oriya, Tajik, Eastern Yiddish, Lombard, Ligurian, Sicilian, Friulian, Sardinian, Galician, Catalan, Icelandic, Tosk Albanian, Limburgish, Dari, Afrikaans, Macedonian, Sinhala, Urdu, Magahi, Bosnian, Armenian; Chinese (Simplified Chinese, Traditional Chinese, Cantonese), Burmese; Arabic (Standard, Najdi, Levantine, Egyptian, Moroccan, Mesopotamian, Ta’izzi-Adeni, Tunisian), Hebrew, Maltese; Indonesian, Malay, Tagalog, Cebuano, Javanese, Sundanese, Minangkabau, Balinese, Banjar, Pangasinan, Iloko, Waray (Philippines); Tamil, Telugu, Kannada, Malayalam; Turkish, North Azerbaijani, Northern Uzbek, Kazakh, Bashkir, Tatar; Thai, Lao; Finnish, Estonian, Hungarian; Vietnamese, Khmer; Japanese, Korean, Georgian, Basque, Haitian, Papiamento, Kabuverdianu, Tok Pisin, Swahili.

--- license: apache-2.0 license_link: LICENSE language:

en
zh
ja
ko
de
fr
ru
ar
hi
es
pt
it
nl
pl
tr
vi
th
id
cs
ro library_name: transformers tags:
- qwen3.5
- qwen3.5-201-languages
- supports-201-languages
- multilingual
- language-support
awq
int4
quantization
moe
mixture-of-experts
noesis
dhcf-fno
qwen3-5-moe
darwin
darwin-v5
reasoning
gpqa
tool-calling
long-context
262k-context base_model: FINAL-Bench/Darwin-35B-A3B-Opus quantized_by: AMAImedia pipeline_tag: text-generation

Qwen3.5-35B-A3B-Darwin-Opus-NOESIS-AWQ-INT4

Custom AWQ-style INT4 quantization of FINAL-Bench/Darwin-35B-A3B-Opus converted from Q8_0 GGUF, optimized for RAM-constrained machines (64 GB RAM, RTX 3060 6 GB).

Released as part of the NOESIS Professional Multilingual Dubbing Automation Platform (framework: DHCF-FNO — Deterministic Hybrid Control Framework for Frozen Neural Operators).

⚠️ License notice

This model is derived from FINAL-Bench/Darwin-35B-A3B-Opus, which itself is derived from Qwen/Qwen3.5-35B-A3B — both licensed under Apache 2.0. This INT4 quantization retains the same Apache 2.0 license — see the LICENSE file in this repository for the full text.

Model summary

Property	Value
Base model	FINAL-Bench/Darwin-35B-A3B-Opus
Quantization source	FINAL-Bench/Darwin-35B-A3B-Opus-Q8-GGUF (Q8_0, ~36.9 GB)
Architecture	`qwen3_5_moe` — Qwen3.5 MoE with Gated DeltaNet
Total parameters	35B
Active parameters	~3B per forward pass (8 routed + 1 shared expert)
Experts per layer	256 routed + 1 shared
Layers	40 (hybrid: 30 GDN/linear_attention + 10 full_attention, every 4th)
Hidden size	2 048
Original vocab size	248 320
Context length	262 144 tokens (native)
Languages	201
Quantization format	Custom nibble AWQ-INT4 (group_size=128, symmetric, no AutoAWQ)
Precision: linear layers	nibble uint8 (weight_i4 [out, in//2] + weight_scale_i4 [n_groups, out])
Precision: MoE experts	nibble uint8 3D (gate_up_proj_q4 [256, out, in//2] + scales/zeros)
Precision: lm_head	BF16 (AWQ standard — output projection kept full precision)
Precision: embed_tokens	BF16
Disk footprint	~17.8 GB
Inference RAM (CPU offload)	~20 GB RAM + ~5.4 GB VRAM (device_map="auto")
`trust_remote_code`	required
Quantization library	Custom pipeline (NOESIS v14.7), no AutoAWQ dependency
RNG seed	1729 (NOESIS reproducibility lock)

Architecture note: Darwin-35B-A3B-Opus was created with Darwin V5 — a diagnostic-guided evolutionary merge engine (DARE-TIES via mergekit).

Father: Qwen/Qwen3.5-35B-A3B (base architecture + RLHF)

Mother: Jackrong/Qwen3.5-35B-A3B-Claude-4.6-Opus-Reasoning-Distilled (LoRA SFT)

Key diagnostic finding: Mother had 50–65% dead experts (activation < 5%) from text-only LoRA SFT. Darwin V5 compensated by reducing Mother density and using Father's living experts to fill inactive slots. Layer 38 (reasoning core) uses 90% Mother weights (peak probe cosine distance).

Benchmark results (original BF16 model, Q8_0 ≈ BF16)

Benchmark	Darwin-35B-A3B-Opus	Father (Qwen3.5-35B-A3B)	Mother (Claude 4.6 Opus Distilled)
GPQA Diamond	90.0%	84.2%	85.0%
MMMLU (29 langs)	85.0%	85.2%	—

Why a custom format (not AutoAWQ / transformers AwqConfig)

AutoAWQ and transformers AwqConfig only quantize standard nn.Linear modules. Darwin-35B stores all 256 routed experts as merged nn.Parameter tensors [256, out_features, in_features] inside Qwen3_5MoeExperts — not as 256 individual nn.Linear modules. AutoAWQ skips them, leaving ~80% of the model weights in BF16 and causing OOM on any device with less than ~65 GB RAM.

This quantization handles both components with a single custom pass:

Component	Approach
All `nn.Linear` (attn, MLP shared expert, router)	`Linear4bit` — nibble uint8, dequantize on forward
`mlp.experts` (256 routed experts per layer)	`Darwin35BExpertsInt4` — nibble uint8 3D, dequantize on forward
`lm_head`, `in_proj_a/b`	BF16 (kept full precision)

Source was the Q8_0 GGUF (not BF16 safetensors), processed layer-by-layer: peak RAM during quantization ~22 GB (one transformer block ~800 MB BF16 at a time).

How to use

Requires trust_remote_code=True — uses custom Darwin35BForCausalLMInt4 class. Do NOT use AutoAWQForCausalLM.from_quantized() — this is not AutoAWQ GEMV format.

python

from transformers import AutoModelForCausalLM, AutoTokenizer
import torch

model_id = "amaimedia/Qwen3.5-35B-A3B-Darwin-Opus-NOESIS-AWQ-INT4"

tokenizer = AutoTokenizer.from_pretrained(model_id, trust_remote_code=True)
model = AutoModelForCausalLM.from_pretrained(
    model_id,
    device_map="auto",
    max_memory={0: "5.4GiB", "cpu": "54GiB"},
    trust_remote_code=True,
    torch_dtype=torch.bfloat16,
)

messages = [{"role": "user", "content": "Explain the Mixture of Experts architecture."}]
text = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
inputs = tokenizer(text, return_tensors="pt").to(model.device)
out = model.generate(**inputs, max_new_tokens=512, do_sample=False)
print(tokenizer.decode(out[0][inputs.input_ids.shape[1]:], skip_special_tokens=True))

CPU-only inference (no GPU):

python

model = AutoModelForCausalLM.from_pretrained(
    model_id,
    device_map="cpu",
    trust_remote_code=True,
    torch_dtype=torch.bfloat16,
)

Note: This format dequantizes weights to BF16 on each forward pass (no dedicated INT4 CUDA kernel). Inference speed is proportional to your CPU/RAM bandwidth. For production fast inference, use the AWQ-INT8 variant (higher quality, larger) or the original GGUF Q8_0 with llama.cpp.

Thinking mode

Darwin-35B-A3B-Opus supports thinking mode (enabled by default at temperature < 0.7). Use <think> tags or set the generation config to control reasoning:

python

# Disable thinking (faster, less verbose)
out = model.generate(
    **inputs,
    max_new_tokens=1024,
    temperature=1.0,
    do_sample=True,
)

# Enable extended thinking (default at temperature ≤ 0.6)
out = model.generate(
    **inputs,
    max_new_tokens=4096,
    temperature=0.6,
    do_sample=True,
)

NOESIS context

In NOESIS this model serves as a high-capability reasoning teacher for Specialists M4-CHAT, M5-CODE, and M6-RESEARCH during knowledge distillation (step110 in extraction_master.py). Proposed KD weight: w=0.25.

⚠️ KD pipeline note: Darwin-35B-A3B-Opus has vocab_size=248 320 (Qwen3.5 extended vocab including codec and vision tokens), while NOESIS student models use Qwen3-8B native vocab 151 936. Logit extraction requires vocab head truncation to index 151 936 via purify_logits() before ensemble aggregation in build_ensemble_labels.py.

ID	Role	Size
M1	ASR (150+ langs)	10B/3B
M2	Dubbing LM (30 langs full)	10B/3B
M3	TTS + voice cloning	10B/3B
M4	Chat + creative writing	10B/3B
M5	Code + math	10B/3B
M6	Deep research (1M ctx)	10B/3B
M7	Prompt engineering	4B/0.8B
M8	Quality control (PRM)	4B/0.8B
M9	Orchestrator + routing	4B/0.8B

Provenance

A noesis_provenance.json file ships alongside the model weights with the full quantization trace: source GGUF path, NOESIS version, quantization methodology, group size, and specialist assignment.

Acknowledgements & citation

Base model: Darwin-35B-A3B-Opus by FINAL-Bench (Darwin V5 evolutionary merge of Qwen3.5-35B-A3B + Claude 4.6 Opus Reasoning Distilled).

bibtex

@misc{darwin35b_opus,
  title     = {Darwin-35B-A3B-Opus},
  author    = {FINAL-Bench},
  year      = {2026},
  publisher = {HuggingFace},
  url       = {https://huggingface.co/FINAL-Bench/Darwin-35B-A3B-Opus}
}

bibtex

@misc{darwin35b_opus_gguf,
  title     = {Darwin-35B-A3B-Opus-Q8-GGUF},
  author    = {VIDRAFT},
  year      = {2026},
  publisher = {HuggingFace},
  url       = {https://huggingface.co/FINAL-Bench/Darwin-35B-A3B-Opus-Q8-GGUF}
}

Quantization & NOESIS integration:

bibtex

@misc{noesis_v14,
  title     = {NOESIS v14.7: DHCF-FNO Multilingual Dubbing Platform},
  author    = {Bolotnikov, Ilia},
  year      = {2026},
  publisher = {AMAImedia},
  url       = {https://amaimedia.com}
}

AMAImedia/Qwen3.5-35B-A3B-Darwin-Opus-NOESIS-AWQ-INT4

NOESIS / AMAImedia

Language support

Qwen3.5-35B-A3B-Darwin-Opus-NOESIS-AWQ-INT4

⚠️ License notice

Model summary

Benchmark results (original BF16 model, Q8_0 ≈ BF16)

Why a custom format (not AutoAWQ / transformers AwqConfig)

How to use

Thinking mode

NOESIS context

Provenance

Acknowledgements & citation

AMAImedia/
Qwen3.5-35B-A3B-Darwin-Opus-NOESIS-AWQ-INT4