Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
DeepSeek-V3-0324-HFK-E192-GGUF – AI Model by bobchenyx | AlphaNeural AI
You can deploy this model and start earning money today!
bobchenyx
/
DeepSeek-V3-0324-HFK-E192-GGUF
like
0
deepseek-ai/DeepSeek-V3-0324
quantized
conversational
deepseek
deepseek_v3
endpoints_compatible
gguf
GGUF
imatrix
template
mit
us
text-generation
transformers
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
Llamacpp Quantizations of DeepSeek-V3-0324-MoE-Pruner-E192 by tflsxyy
Original model:
tflsxyy/DeepSeek-V3-0324-MoE-Pruner-E192-bf16
.
All quants made with modification of llama.cpp based on
bartowski1182-llama.cpp
.
All quants made using imatrix option based on
tflsxyy/DeepSeek-V3-0324-MoE-Pruner-imatrix
.
IQ1_M / Q4_K / Q8_0 : 110.19 GiB(1.87 BPW)
IQ1_S / Q4_K / Q8_0 : 99.45 GiB (1.68 BPW)