Beta

Explore
Marketplace
Neural Labs
Chat
Wallet
Docs

Beta

Explore Marketplace Neural Labs Wallet Docs

Build

Manage

My assets Manage wallet Organization

Community

Discord X (Twitter)Telegram

Docs Privacy Policy Terms and Conditions

Proud member of

Proud member of

Docs Cookie Policy

Privacy Policy Terms and Conditions

© 2026 AlphaNeural AI. All rights reserved.

Qwen3.6-27B-INT8 – AI Model by TheHouseOfTheDude | AlphaNeural AI

You can deploy this model and start earning money today!

TheHouseOfTheDude/
Qwen3.6-27B-INT8

like

0

text-generation

image-generation

compressed-tensors

image-text-to-text

Qwen/Qwen3.6-27B

Views

No views yet

Qwen3.6-27B-INT8 — PTQ Quantized (W8A16)

Overview

Post-Training Quantized (PTQ) version of Qwen/Qwen3.6-27B.

No calibration dataset
One-shot quantization
Uses llmcompressor

Quantization

Scheme: W8A16
Weights: INT8
Activations: FP16/BF16
Targets: Linear layers only

Ignored:

lm_head
visual
linear_attn
mtp

KLD Results:

Mean KLD: 0.009441

Usage

bash

vllm serve TheHouseOfTheDude/Qwen3.6-27B-INT8 \
  --quantization compressed-tensors

Notes

Requires vLLM
Not for vanilla Transformers