Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
Qwen1.5-32B-Chat-iMat-GGUF – AI Model by qwp4w3hyb | AlphaNeural AI
You can deploy this model and start earning money today!
qwp4w3hyb
/
Qwen1.5-32B-Chat-iMat-GGUF
like
0
quantized
Qwen/Qwen1.5-32B-Chat
chat
conversational
en
endpoints_compatible
gguf
template
other
qwen
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
Qwen1.5-32B-Chat-iMat-GGUF
Source Model:
Qwen/Qwen1.5-32B-Chat
Quantized with
llama.cpp
commit
46acb3676718b983157058aecf729a2064fc7d34
Imatrix was generated from the f16 gguf via this command:
./imatrix -c 512 -m $out_path/$base_quant_name -f $llama_cpp_path/groups_merged.txt -o $out_path/imat-f16-gmerged.dat
Using the dataset from
here
