Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
Qwen3-235B-A22B-Thinking-2507-exl3 – AI Model by MikeRoz | AlphaNeural AI
You can deploy this model and start earning money today!
MikeRoz
/
Qwen3-235B-A22B-Thinking-2507-exl3
like
0
exllamav3
exl3
text-generation
Qwen/Qwen3-235B-A22B-Thinking-2507
quantized
apache-2.0
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
Exllamav3 quantizations of
Qwen/Qwen3-235B-A22B-Thinking-2507
2.10 bpw h6
59.287 GiB
2.80 bpw h6
78.295 GiB
3.60 bpw h6
100.116 GiB
4.25 bpw h6
117.803 GiB
The 2.10 bpw quant will fit in three 24 GB cards with 45k of context.
The 2.80 bpw quant will fit in four 24 GB cards with 57k of context.
The 3.60 bpw quant will fit in five 24 GB cards with 57k of context.
The 4.25 bpw quant will fit in six 24 GB cards with 73k of context.