Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
Starling-LM-7B-beta-iMat-GGUF – AI Model by qwp4w3hyb | AlphaNeural AI
You can deploy this model and start earning money today!
qwp4w3hyb
/
Starling-LM-7B-beta-iMat-GGUF
like
0
Nexusflow/Starling-LM-7B-beta
quantized
conversational
berkeley-nest/Nectar
en
endpoints_compatible
gguf
template
apache-2.0
us
reward model
RLAIF
RLHF
starling
transformers
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
Starling-LM-7B-beta-iMat-GGUF
Source Model:
Nexusflow/Starling-LM-7B-beta
Quantized with
llama.cpp
commit
46acb3676718b983157058aecf729a2064fc7d34
Imatrix was generated from the f16 gguf via this command:
./imatrix -c 512 -m $out_path/$base_quant_name -f $llama_cpp_path/groups_merged.txt -o $out_path/imat-f16-gmerged.dat
Using the dataset from
here
