Views
No views yet
preprocessor_config.json, video_preprocessor_config.json); an mmproj file can be generated from the source safetensors for multimodal use| File | Size | Description |
|---|---|---|
Huihui-Qwen3.5-35B-A3B-Claude-4.6-Opus-abliterated-Q4_K_M.gguf | ~20 GB | Main text model (Q4_K_M) |
Huihui-Qwen3.5-35B-A3B-Claude-4.6-Opus-abliterated-mmproj-F16.gguf | ~858 MB | Vision projector for image input |
| Source model | huihui-ai/Huihui-Qwen3.5-35B-A3B-Claude-4.6-Opus-abliterated |
| Architecture | qwen35moe (35B total params, ~3B active; 256 experts, 8 active per token) |
| Quantization | Q4_K_M (~4.88 BPW) |
| File size | ~20 GB + 858 MB mmproj |
| Quantized with | llama.cpp b8352 |
| Context length | 262,144 tokens (trained) |
1llama-cli \
2 --hf-repo cesarsal1nas/Huihui-Qwen3.5-35B-A3B-Claude-4.6-Opus-abliterated-Q4_K_M-GGUF \
3 --hf-file Huihui-Qwen3.5-35B-A3B-Claude-4.6-Opus-abliterated-Q4_K_M.gguf \
4 -p "Tell me about the universe"1llama-server \
2 --hf-repo cesarsal1nas/Huihui-Qwen3.5-35B-A3B-Claude-4.6-Opus-abliterated-Q4_K_M-GGUF \
3 --hf-file Huihui-Qwen3.5-35B-A3B-Claude-4.6-Opus-abliterated-Q4_K_M.gguf \
4 -c 1310721llama-server \
2 --hf-repo cesarsal1nas/Huihui-Qwen3.5-35B-A3B-Claude-4.6-Opus-abliterated-Q4_K_M-GGUF \
3 --hf-file Huihui-Qwen3.5-35B-A3B-Claude-4.6-Opus-abliterated-Q4_K_M.gguf \
4 --mmproj Huihui-Qwen3.5-35B-A3B-Claude-4.6-Opus-abliterated-mmproj-F16.gguf \
5 -c 131072ollama run hf.co/cesarsal1nas/Huihui-Qwen3.5-35B-A3B-Claude-4.6-Opus-abliterated-Q4_K_M-GGUF