You can deploy this model and start earning money today!

UnstableLlama/
Qwen3.5-2B-exl3-3.10bpw

Name: Qwen3.5-2B-exl3-3.10bpw
Availability: InStock

Views

No views yet

Qwen / Qwen3.5-2B

QUANTIZED BY: UnstableLlama

Information

⚠️ Requires ExLlamaV3 v0.0.23 (or v0.0.22 `dev` branch)
exl3 quantizations of Qwen3.5-2B via exllamav3.
repo generated automatically with ezexl3.

Repo Data

REVISION	GiB	KL DIV	PPL
2.10bpw	2.26	0.2965	15.8161
3.10bpw	2.42	0.0593	13.1512
4.00bpw	2.56	0.0140	12.3285
5.00bpw	2.72	0.0041	12.2906
6.00bpw	2.88	0.0013	12.1723
8.00bpw	3.20	0.0004	12.1875
bf16	4.24	0.0000	12.1829

CLI Download

hf download UnstableLlama/Qwen3.5-2B-exl3-4.00bpw --local-dir ./Qwen3.5-2B-exl3-4.00bpw

UnstableLlama/Qwen3.5-2B-exl3-3.10bpw

Qwen / Qwen3.5-2B

UnstableLlama/
Qwen3.5-2B-exl3-3.10bpw