Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
WeDLM-8B-Instruct-MLX – AI Model by zimengxiong | AlphaNeural AI
You can deploy this model and start earning money today!
zimengxiong
/
WeDLM-8B-Instruct-MLX
like
0
mlx
safetensors
wedlm
fp16
diffusion
text-generation
conversational
custom_code
en
tencent/WeDLM-8B-Instruct
finetune
apache-2.0
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
WeDLM-8B-Instruct-MLX
This is a full-precision (fp16)
MLX
version of
tencent/WeDLM-8B-Instruct
for inference on Apple Silicon.
It currently does not work too well or provide meaningfull speedup due to lack of pre compilation.
https://github.com/ZimengXiong/WeDLM-MLX/tree/main
Related Models
Variant
HuggingFace
4-bit
zimengxiong/WeDLM-8B-Instruct-MLX-4bit
8-bit
zimengxiong/WeDLM-8B-Instruct-MLX-8bit
fp16 (this model)
zimengxiong/WeDLM-8B-Instruct-MLX
License
This model inherits the license from the base model
tencent/WeDLM-8B-Instruct
.
