Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
DeepSeek-R1-Distill-Llama-70B-abliterated-AWQ – AI Model by Ewere | AlphaNeural AI
You can deploy this model and start earning money today!
Ewere
/
DeepSeek-R1-Distill-Llama-70B-abliterated-AWQ
like
0
safetensors
llama
huihui-ai/DeepSeek-R1-Distill-Llama-70B-abliterated
quantized
4-bit
awq
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
Needed to run a 4-bit quantization on vLLM but only GGUFs were available.
Loading time went from ~9 minutes to 2.5 minutes. Throughput went from 25 tokens/second to 45 tokens/second.