Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
Nous-Hermes-2-Yi-34B-iMat-GGUF – AI Model by qwp4w3hyb | AlphaNeural AI
You can deploy this model and start earning money today!
qwp4w3hyb
/
Nous-Hermes-2-Yi-34B-iMat-GGUF
like
0
NousResearch/Nous-Hermes-2-Yi-34B
quantized
chatml
conversational
teknium/OpenHermes-2.5
distillation
en
endpoints_compatible
finetune
gguf
gpt4
instruct
template
apache-2.0
us
synthetic data
yi
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
Nous-Hermes-2-Yi-34B-iMat-GGUF
Source Model:
NousResearch/Nous-Hermes-2-Yi-34B
Quantized with
llama.cpp
commit
46acb3676718b983157058aecf729a2064fc7d34
Imatrix was generated from the f16 gguf via this command:
./imatrix -c 512 -m $out_path/$base_quant_name -f $llama_cpp_path/groups_merged.txt -o $out_path/imat-f16-gmerged.dat
Using the dataset from
here
