Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
anthracite-magnum-v3-34b-awq – AI Model by andriadze | AlphaNeural AI
You can deploy this model and start earning money today!
andriadze
/
anthracite-magnum-v3-34b-awq
like
0
safetensors
llama
awq
text-generation-inference
text-generation
conversational
anthracite-org/magnum-v3-34b
quantized
4-bit
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
Model Details
This is a AWQ GEMM quant of magnum-v3-34b:
https://huggingface.co/anthracite-org/magnum-v3-34b
Model Description
Model has been quantized on 6xRTX4090, here are quantization parameters:
"zero_point": True, "q_group_size": 128, "w_bit": 4, "version": "GEMM"