Qwen3.5-4B-exl3-4.00bpw – AI Model by UnstableLlama | AlphaNeural AI

You can deploy this model and start earning money today!

UnstableLlama/
Qwen3.5-4B-exl3-4.00bpw

like

0

Qwen/Qwen3.5-4B

Views

No views yet

Qwen / Qwen3.5-4B-exl3

QUANTIZED BY: UnstableLlama

Information

exl3 quantizations of Qwen3.5-4B-exl3 via exllamav3.
repo generated automatically with ezexl3.

Repo Data

Quantization graph

REVISION	GiB	KL DIV	PPL
2.00bpw	3.09	0.3653	12.2025
2.10bpw	3.13	0.2848	11.4102
3.00bpw	3.51	0.0631	9.9813
3.10bpw	3.54	0.0584	9.8489
4.00bpw	3.92	0.0187	9.6894
5.00bpw	4.34	0.0060	9.6490
6.00bpw	4.75	0.0020	9.6689
8.00bpw	5.58	0.0010	9.6854
bf16	8.68	0.0000	9.6736

CLI Download

hf download UnstableLlama/Qwen3.5-4B-exl3-4.00bpw --local-dir ./Qwen3.5-4B-exl3-4.00bpw