model	size	params	backend	ngl	n_batch	n_ubatch	fa	test	t/s
qwen35moe 122B.A10B Q4_1	94.79 GiB	122.11 B	ROCm	999	1024	1024	1	pp2048	274.99 ± 0.00
qwen35moe 122B.A10B Q4_1	94.79 GiB	122.11 B	ROCm	999	1024	1024	1	tg256	16.62 ± 0.00
qwen35moe 122B.A10B Q4_1	94.79 GiB	122.11 B	ROCm	999	1024	1024	1	pp2048 @ d8192	238.78 ± 0.00
qwen35moe 122B.A10B Q4_1	94.79 GiB	122.11 B	ROCm	999	1024	1024	1	tg256 @ d8192	16.68 ± 0.00

Ignore displayed dtype, refer to the tensor types instead

See the GLM version for more details on theory and comparisons.

Beinsezii/Qwen3.5-122B-A10B-GGUF-HALO

Beinsezii/
Qwen3.5-122B-A10B-GGUF-HALO