Beta

Explore
Marketplace
Neural Labs
Chat
Wallet
Docs

Beta

Explore Marketplace Neural Labs Wallet Docs

Build

Manage

My assets Manage wallet Organization

Community

Discord X (Twitter)Telegram

Docs Privacy Policy Terms and Conditions

Proud member of

Proud member of

Docs Cookie Policy

Privacy Policy Terms and Conditions

© 2026 AlphaNeural AI. All rights reserved.

qwen3-embedding-0.6b-awq-int4 – AI Model by phunghuy159 | AlphaNeural AI

You can deploy this model and start earning money today!

phunghuy159/
qwen3-embedding-0.6b-awq-int4

like

0

text-generation

Qwen/Qwen3-Embedding-0.6B

endpoints_compatible

Views

No views yet

Qwen3 Embedding 0.6B AWQ INT4

This repo contains AWQ post-training quantization artifacts for Qwen/Qwen3-Embedding-0.6B.

Files

qwen3-embedding-0.6b-w4-g128-dummy.pt: AWQ search results with scales/clips.
qwen3-embedding-0.6b-w4-g128-awq-v2.pt: packed INT4 AWQ state dict.
quant_config.json: quantization metadata.
tokenizer/config files copied from the base model.

Quantization

Method: AWQ PTQ
Weight bits: INT4
Group size: 128
Zero point: true
Calibration data: dummy local text
Calibration samples: 16
Calibration sequence length: 128

Loading note

The packed INT4 checkpoint requires AWQ CUDA kernels/custom AWQ loading code for direct inference. It is not a vanilla AutoModel.from_pretrained model folder.