Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
Phi-3-mini-128k-instruct-AQLM-1x16 – AI Model by ISTA-DASLab | AlphaNeural AI
You can deploy this model and start earning money today!
ISTA-DASLab
/
Phi-3-mini-128k-instruct-AQLM-1x16
like
0
transformers
safetensors
phi3
text-generation
nlp
code
microsoft
conversational
custom_code
en
2401.06118
autotrain_compatible
text-generation-inference
endpoints_compatible
aqlm
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
Official
AQLM
quantization of
microsoft/Phi-3-mini-128k-instruct
.
For this quantization, we used 1 codebook of 16 bits.
Results:
Model
Quantization
MMLU (5-shot)
ArcC
ArcE
Hellaswag
Winogrande
PiQA
Model size, Gb
microsoft/Phi-3-mini-128k-instruct
None
0.6881
0.5418
0.8127
0.5980
0.7873
0.7340
7.6
1x16
0.5815
0.4599
0.7845
0.5235
0.7666
0.6930
1.4
