Beta

Explore
Marketplace
Neural Labs
Chat
Wallet
Docs

Beta

Explore Marketplace Neural Labs Wallet Docs

Build

Manage

My assets Manage wallet Organization

Community

Discord X (Twitter)Telegram

Docs Privacy Policy Terms and Conditions

Proud member of

Proud member of

Docs Cookie Policy

Privacy Policy Terms and Conditions

© 2026 AlphaNeural AI. All rights reserved.

Huihui-Qwen3-VL-8B-Instruct-abliterated-AWQ-int4 – AI Model by quant-mind | AlphaNeural AI

You can deploy this model and start earning money today!

quant-mind/
Huihui-Qwen3-VL-8B-Instruct-abliterated-AWQ-int4

like

0

image-text-to-text

compressed-tensors

huihui-ai/Huihui-Qwen3-VL-8B-Instruct-abliterated

endpoints_compatible

Views

No views yet

Huihui-Qwen3-VL-8B-Instruct-abliterated-AWQ-int4

Quantização AWQ int4 (W4A16) de huihui-ai/Huihui-Qwen3-VL-8B-Instruct-abliterated, produzida com llm-compressor.

Configuração (ajustada para máxima precisão)

Esquema: W4A16 (pesos int4 simétricos por grupo, ativações em 16-bit)
group_size: 32
Amostras de calibração: 512 (lmms-lab/flickr30k)
max_seq_length: 2048
duo_scaling: False
Mantidos em bf16 (não quantizados): torre de visão (visual.*) e lm_head

Uso com vLLM

vllm serve quant-mind/Huihui-Qwen3-VL-8B-Instruct-abliterated-AWQ-int4 --quantization compressed-tensors --max-model-len 8192