Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
Senku-70B-AWQ-4bit-GEMM – AI Model by bigquant | AlphaNeural AI
You can deploy this model and start earning money today!
bigquant
/
Senku-70B-AWQ-4bit-GEMM
like
0
transformers
safetensors
llama
text-generation
AWQ
Miqu
Senku
conversational
autotrain_compatible
text-generation-inference
endpoints_compatible
4-bit
awq
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
A quantized version of
Shinoji Research's Senku 70B Full
. Quantized through AWQ:
Quantization settings:
{"zero_point": True, "q_group_size": 128, "w_bit": 4, "version": "GEMM" }
