Beta

Explore
Marketplace
Neural Labs
Chat
Wallet
Docs

Beta

Explore Marketplace Neural Labs Wallet Docs

Build

Manage

My assets Manage wallet Organization

Community

Discord X (Twitter)Telegram

Docs Privacy Policy Terms and Conditions

Proud member of

Proud member of

Docs Cookie Policy

Privacy Policy Terms and Conditions

© 2026 AlphaNeural AI. All rights reserved.

Phi-4-mini-instruct-AWQ-4bit – AI Model by Sumo10 | AlphaNeural AI

You can deploy this model and start earning money today!

Sumo10/
Phi-4-mini-instruct-AWQ-4bit

like

0

Views

No views yet

Phi-4-mini-instruct - AWQ Quantized (4-bit)

This is a 4-bit AWQ quantized version of microsoft/Phi-4-mini-instruct.

Quantized using:

w_bit: 4
q_group_size: 128
zero_point: true

Usage

python

from awq import AutoAWQForCausalLM
from transformers import AutoTokenizer

model = AutoAWQForCausalLM.from_quantized("Sumo10/Phi-4-mini-instruct-AWQ-4bit")
tokenizer = AutoTokenizer.from_pretrained("Sumo10/Phi-4-mini-instruct-AWQ-4bit")

input_ids = tokenizer("What is quantum computing?", return_tensors="pt").input_ids
output = model.generate(input_ids)
print(tokenizer.decode(output[0]))