Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
Huihui-Qwen3-VL-30B-A3B-Thinking-abliterated-GGUF – AI Model by noctrex | AlphaNeural AI
You can deploy this model and start earning money today!
noctrex
/
Huihui-Qwen3-VL-30B-A3B-Thinking-abliterated-GGUF
like
0
gguf
image-text-to-text
huihui-ai/Huihui-Qwen3-VL-30B-A3B-Thinking-abliterated
quantized
endpoints_compatible
us
imatrix
conversational
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
These are quantizations of the model Huihui-Qwen3-VL-30B-A3B-Thinking-abliterated
The imatrix from unsloth has been used for these.
Original model:
https://huggingface.co/huihui-ai/Huihui-Qwen3-VL-30B-A3B-Thinking-abliterated
Download the latest llama.cpp to use them.
Try to use the best quality you can run.
For the mmproj, try to use the F32 version as it will produce the best results.
F32 > BF16 > F16.