Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
Janus-Pro-7B-4bit – AI Model by wnma3mz | AlphaNeural AI
You can deploy this model and start earning money today!
wnma3mz
/
Janus-Pro-7B-4bit
like
0
mlx
safetensors
chat
any-to-any
deepseek-ai/Janus-Pro-7B
quantized
mit
4-bit
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
This model is derived from
https://huggingface.co/deepseek-ai/Janus-Pro-7B
and the main modifications are as follows
bin files are updated to safetensors
Add chat_template
4bit
mainly refers to quantifying the LLM part to 4 bits.
Quick Start
In Macos (Apple silicon), use
mlx
framework
https://github.com/wnma3mz/tLLM
tllm.server --model_path $MODEL_PATH
$MODEL_PATH
like
wnma3mz/Janus-Pro-1B-4bit
