Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
Qwen2.5-Godzilla-Coder-51B-autoAWQ – AI Model by cgg507 | AlphaNeural AI
You can deploy this model and start earning money today!
cgg507
/
Qwen2.5-Godzilla-Coder-51B-autoAWQ
like
0
safetensors
qwen2
DavidAU/Qwen2.5-Godzilla-Coder-51B
quantized
4-bit
awq
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
Quanted using lmdeploy - auto_awq. Going to run benchmarks to see performence.
Ran it up on 4x A4000 GPUs with 32k context. Got 30 t/s per request.