Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
phi-3-mini-4k-instruct-awq-4bit – AI Model by elysiantech | AlphaNeural AI
You can deploy this model and start earning money today!
elysiantech
/
phi-3-mini-4k-instruct-awq-4bit
like
0
transformers
safetensors
phi3
text-generation
text-generation-inference
awq
microsoft
conversational
custom_code
en
2306.00978
other
autotrain_compatible
endpoints_compatible
4-bit
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
Open In Colab
phi-3-mini-4k-instruct-awq-4bit
phi-3-mini-4k-instruct-awq-4bit is a version of the
Microsoft
Phi 3 mini 4k Instruct
model that was quantized using the AWQ method developed by
Lin et al. (2023)
.
Please refer to the
Original Phi 3 mini model card
for details about the model preparation and training processes.
Dependencies
autoawq==0.2.5
–
AutoAWQ
was used to quantize the phi-3 model.
vllm==0.4.2
–
vLLM
was used to host models for benchmarking.
