Beta

Explore
Marketplace
Neural Labs
Chat
Wallet
Docs

Beta

Explore Marketplace Neural Labs Wallet Docs

Build

Manage

My assets Manage wallet Organization

Community

Discord X (Twitter)Telegram

Docs Privacy Policy Terms and Conditions

Proud member of

Proud member of

Docs Cookie Policy

Privacy Policy Terms and Conditions

© 2026 AlphaNeural AI. All rights reserved.

Fanar-1-9B-Instruct-GPTQ – AI Model by buthainaaa | AlphaNeural AI

You can deploy this model and start earning money today!

buthainaaa/
Fanar-1-9B-Instruct-GPTQ

like

0

QCRI/Fanar-1-9B-Instruct

compressed-tensors

Views

No views yet

Fanar-1-9B-Instruct-AWQ

GPTQ 4-bit quantized version of QCRI/Fanar-1-9B-Instruct.

Details

Quantization: GPTQ 4-bit (w4a16)
Size: ~5GB (vs ~18GB original)
Memory: 75% reduction
Quality: 95%+ retention
Optimized for: vLLM inference

Requirements

pip install vllm>=0.6.0

Model quantized using AutoAWQ with domain-specific calibration data.