Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
DeepSeek-R1-Distill-Llama-8B-MLX-Q4 – AI Model by jesusoctavioas | AlphaNeural AI
You can deploy this model and start earning money today!
jesusoctavioas
/
DeepSeek-R1-Distill-Llama-8B-MLX-Q4
like
0
safetensors
llama
en
deepseek-ai/DeepSeek-R1-Distill-Llama-8B
quantized
mit
4-bit
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
This model was converted to MLX format and quantized Q4, from
https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Llama-8B
using mlx-lm version 0.4.0. Refer to the original model card for more details on the model.
Use with mlx . pip install mlx-lm . from mlx_lm import load, generate
model, tokenizer = load("jesusoctavioas/DeepSeek-R1-Distill-Llama-8B-MLX-Q4") response = generate(model, tokenizer, prompt="hello", verbose=True)
Original model link
https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Llama-8B
.
