Beta
Explore
Marketplace
Neural Labs
Playground
Wallet
Docs
Mistral-Small-24B-Instruct-2501-writer-AWQ – AI Model by lars1234 | AlphaNeural AI
You can deploy this model and start earning money today!
lars1234
/
Mistral-Small-24B-Instruct-2501-writer-AWQ
like
0
safetensors
mistral
lars1234/story_writing_benchmark
lars1234/Mistral-Small-24B-Instruct-2501-writer
quantized
apache-2.0
4-bit
awq
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
Mistral-Small-24B-Instruct-2501-writer-AWQ
This model is the 4-bit AWQ-quantized version of
Mistral-Small-24B-Instruct-2501-writer
.
Quantization Method
: AWQ (Activation-aware Weight Quantization)
Quantization Configuration
:
Bit Width: 4-bit
Group Size: 128
Zero Point: Enabled
Version: GEMM
