Beta

Explore
Marketplace
Neural Labs
Chat
Wallet
Docs

Beta

Explore Marketplace Neural Labs Wallet Docs

Build

Manage

My assets Manage wallet Organization

Community

Discord X (Twitter)Telegram

Docs Privacy Policy Terms and Conditions

Proud member of

Proud member of

Docs Cookie Policy

Privacy Policy Terms and Conditions

© 2026 AlphaNeural AI. All rights reserved.

Llama-3.1-8B-Instruct-quantized.w8a8 – AI Model by DESUCLUB | AlphaNeural AI

You can deploy this model and start earning money today!

DESUCLUB/
Llama-3.1-8B-Instruct-quantized.w8a8

like

0

text-generation

meta-llama/Llama-3.1-8B-Instruct

autotrain_compatible

text-generation-inference

endpoints_compatible

compressed-tensors

Views

No views yet

DESUCLUB/Llama-3.1-8B-Instruct-quantized.w8a8

This is a custom W8A16 quantized version of meta-llama/Llama-3.1-8B-Instruct.

Quantization Details

Method: Custom W8A16 (8-bit weights, 16-bit activations)
Weight precision: INT8
Scale precision: BF16
Quantization: Symmetric per-channel
Zero points: None (symmetric)

Model Structure

The quantized model contains:

.weight: INT8 quantized weights
.weight_scale: BF16 scale parameters (trainable)
Standard embedding and normalization layers in original precision

Usage

python

from transformers import AutoModelForCausalLM, AutoTokenizer

# Note: This requires custom quantization code to load properly
model = AutoModelForCausalLM.from_pretrained("DESUCLUB/Llama-3.1-8B-Instruct-quantized.w8a8")
tokenizer = AutoTokenizer.from_pretrained("DESUCLUB/Llama-3.1-8B-Instruct-quantized.w8a8")