Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
Mixtral-8x7B-Instruct-v0.1-iMat-GGUF – AI Model by qwp4w3hyb | AlphaNeural AI
You can deploy this model and start earning money today!
qwp4w3hyb
/
Mixtral-8x7B-Instruct-v0.1-iMat-GGUF
like
0
mistralai/Mixtral-8x7B-Instruct-v0.1
quantized
conversational
de
en
endpoints_compatible
es
fr
gguf
instruct
template
it
apache-2.0
Mistral
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
Mixtral-8x7B-Instruct-v0.1-iMat-GGUF
Source Model:
mistralai/Mixtral-8x7B-Instruct-v0.1
Quantized with
llama.cpp
commit
46acb3676718b983157058aecf729a2064fc7d34
Imatrix was generated from the f16 gguf via this command:
./imatrix -c 512 -m $out_path/$base_quant_name -f $llama_cpp_path/groups_merged.txt -o $out_path/imat-f16-gmerged.dat
Using the dataset from
here