Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
deepseek-ai.DeepSeek-V3.2-Speciale-Channel-INT8 – AI Model by DevQuasar | AlphaNeural AI
You can deploy this model and start earning money today!
DevQuasar
/
deepseek-ai.DeepSeek-V3.2-Speciale-Channel-INT8
like
0
transformers
safetensors
deepseek_v3
text-generation
conversational
custom_code
deepseek-ai/DeepSeek-V3.2-Speciale
finetune
mit
text-generation-inference
endpoints_compatible
8-bit
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
'Make knowledge free for everyone'
EXPERIMENTAL!
Channel wise INT8 quant. Requires CPU with AMX support (Xeon 5 and above) and 700GB-1TB ram. Not tested due to hardware.
SGlang sould support it.
SGlang CPU
Made with
https://huggingface.co/meituan/DeepSeek-R1-Channel-INT8/blob/main/inference/bf16_cast_channel_int8.py
Buy Me a Coffee at ko-fi.com