Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
Phi-3-mini-4k-instruct-AQLM-1x16 – AI Model by ISTA-DASLab | AlphaNeural AI
You can deploy this model and start earning money today!
ISTA-DASLab
/
Phi-3-mini-4k-instruct-AQLM-1x16
like
0
transformers
safetensors
phi3
text-generation
nlp
code
microsoft
conversational
custom_code
en
2401.06118
autotrain_compatible
text-generation-inference
endpoints_compatible
aqlm
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
Official
AQLM
quantization of
microsoft/Phi-3-mini-4k-instruct
.
For this quantization, we used 1 codebook of 16 bits.
Results:
Model
Quantization
MMLU (5-shot)
ArcC
ArcE
Hellaswag
Winogrande
PiQA
Model size, Gb
microsoft/Phi-3-mini-4k-instruct
None
0.6949
0.5529
0.8325
0.6055
0.8020
0.7364
7.6
1x16
0.5818
0.4642
0.7807
0.5311
0.7715
0.7072
1.4
