Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
GUI-Owl-7B-AWQ-4bit – AI Model by JessieWei | AlphaNeural AI
You can deploy this model and start earning money today!
JessieWei
/
GUI-Owl-7B-AWQ-4bit
like
0
safetensors
qwen2_5_vl
apache-2.0
4-bit
awq
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
Quantization Details
Quantization Method:
AWQ
Bits:
4
Group Size:
128
Quantization Tool:
ms-swift
Memory Usage
Type
GUI-Owl-7B
GUI-Owl-7B-AWQ-4bit
Memory Size
16G GB
6.5 GB
Inference
Run with:
vllm serve JessieWei/GUI-Owl-7B-AWQ-4bit
Detailed parameter tuning refer to
GUI-Owl-7B
.