Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
lolzinventor_Qwen3.5-4B-Base-ZitGen-V2-GGUF – AI Model by thirteenbit | AlphaNeural AI
You can deploy this model and start earning money today!
thirteenbit
/
lolzinventor_Qwen3.5-4B-Base-ZitGen-V2-GGUF
like
0
gguf
lolzinventor/Qwen3.5-4B-Base-ZitGen-V2
quantized
endpoints_compatible
us
conversational
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
Llama.cpp Quantization of Qwen3.5-4B-Base-ZitGen-V2 by lolzinventor
Using
llama.cpp
release
b8914
for quantization.
Original model:
lolzinventor/Qwen3.5-4B-Base-ZitGen-V2
Download a file (not the whole branch) from below:
Filename
Quant type
File Size
Description
lolzinventor_Qwen3.5-4B-Base-ZitGen-V2-GGUF-Q4_K_M.gguf
Q4_K_M
2,6G
Good quality
lolzinventor_Qwen3.5-4B-Base-ZitGen-V2-GGUF-Q8_0.gguf
Q8_0
4,2G
High quality
Download mmproj
Download mmproj from Qwen3.5-4B model, for example from
bartowski/Qwen_Qwen3.5-4B-GGUF
:
mmproj-Qwen_Qwen3.5-4B-bf16.gguf
