Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
Qwopus3.6-27B-v2-heretic-GGUF – AI Model by snowman0919 | AlphaNeural AI
You can deploy this model and start earning money today!
snowman0919
/
Qwopus3.6-27B-v2-heretic-GGUF
like
0
gguf
llama.cpp
vllm
qwen
qwopus
text-generation
Jackrong/Qwopus3.6-27B-v2
quantized
other
endpoints_compatible
us
conversational
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
Qwopus3.6-27B-v2-heretic-GGUF
GGUF conversion of Qwopus3.6-27B-v2-heretic.
Files
Qwopus3.6-27B-v2-heretic-F16.gguf
Qwopus3.6-27B-v2-heretic-Q4_K_M.gguf
Recommended runtime
For llama.cpp or llama-server, use Q4_K_M for normal inference.
For vLLM, GGUF support is experimental. Prefer the HF safetensors model when possible. If using GGUF with vLLM, use the Q4_K_M file with the base tokenizer and base HF config.
