Beta

Explore
Marketplace
Neural Labs
Chat
Wallet
Docs

Beta

Explore Marketplace Neural Labs Wallet Docs

Build

Manage

My assets Manage wallet Organization

Community

Discord X (Twitter)Telegram

Docs Privacy Policy Terms and Conditions

Proud member of

Proud member of

Docs Cookie Policy

Privacy Policy Terms and Conditions

© 2026 AlphaNeural AI. All rights reserved.

Llama-3.1-8B-Instruct-gptqmodel-4bit-g32 – AI Model by iproskurina | AlphaNeural AI

You can deploy this model and start earning money today!

iproskurina/
Llama-3.1-8B-Instruct-gptqmodel-4bit-g32

like

0

text-generation

meta-llama/Llama-3.1-8B

Views

No views yet

Llama-3.1-8B-Instruct - GPTQ (4-bit)

Source model: meta-llama/Llama-3.1-8B-Instruct

This model was quantized to 4-bit using GPTQModel.

Quantization parameters:

bits: 4
group_size: 32
damp_percent: 0.05
desc_act: False

Usage

python

# pip install transformers gptqmodel --no-build-isolation
from gptqmodel import GPTQModel
model_id = "iproskurina/Llama-3.1-8B-Instruct-gptqmodel-4bit-g32"
model = GPTQModel.load(model_id)
result = model.generate("Uncovering deep insights")[0]
print(model.tokenizer.decode(result))