Beta

Explore
Marketplace
Neural Labs
Chat
Wallet
Docs

Beta

Explore Marketplace Neural Labs Wallet Docs

Build

Manage

My assets Manage wallet Organization

Community

Discord X (Twitter)Telegram

Docs Privacy Policy Terms and Conditions

Proud member of

Proud member of

Docs Cookie Policy

Privacy Policy Terms and Conditions

© 2026 AlphaNeural AI. All rights reserved.

Qwen3-0.6B-bnb-4bit-nf4-dq – AI Model by manu02 | AlphaNeural AI

You can deploy this model and start earning money today!

manu02/
Qwen3-0.6B-bnb-4bit-nf4-dq

like

0

text-generation

Qwen/Qwen3-0.6B

text-generation-inference

endpoints_compatible

Views

No views yet

Qwen3-0.6B (Quantized)

Description

This model is a 4-bit quantized version of the original Qwen/Qwen3-0.6B model, optimized for reduced memory usage while maintaining performance.

Quantization Details

Quantization Type: 4-bit
bnb_4bit_quant_type: nf4
bnb_4bit_use_double_quant: True
bnb_4bit_compute_dtype: bfloat16
bnb_4bit_quant_storage: uint8
Original Footprint: 1192.10 MB (BFLOAT16)
Quantized Footprint: 842.66 MB (UINT8)
Memory Reduction: 29.3%

Usage

python

from transformers import AutoModel, AutoTokenizer

model_name = "Qwen3-0.6B-bnb-4bit-nf4"
model = AutoModel.from_pretrained(
    "manu02/Qwen3-0.6B-bnb-4bit-nf4",
)
tokenizer = AutoTokenizer.from_pretrained("manu02/Qwen3-0.6B-bnb-4bit-nf4", use_fast=True)