Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
phi-4-6.0bpw-exl2 – AI Model by roleplaiapp | AlphaNeural AI
You can deploy this model and start earning money today!
roleplaiapp
/
phi-4-6.0bpw-exl2
like
0
safetensors
phi3
exllama
exl2
phi
code
math
tchat
text-generation
conversational
custom_code
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
Quantization
: ExLlamaV2 (ExL2) at
6 bits
per weight.
Overview
This is an ExLlamaV2 (ExL2) 6 bpw quantized version of
microsoft/phi-4
.
Quantization By
I often have idle A100 GPUs while building/testing the app, so I put them to use quantizing models.
I hope the community finds these quantizations useful.
Andrew Webby @
RolePlai
