Beta
Explore
Marketplace
Neural Labs
Playground
Wallet
Docs
WizardLM-30B-Guanaco-SuperCOT-GPTQ-4bit – AI Model by benjicolby | AlphaNeural AI | AlphaNeural AI
You can deploy this model and start earning money today!
benjicolby
/
WizardLM-30B-Guanaco-SuperCOT-GPTQ-4bit
like
0
transformers
pytorch
llama
text-generation
autotrain_compatible
text-generation-inference
endpoints_compatible
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
This is a GPTQ 4-bit version of
WizardLM-30B-Uncensored-Guanaco-SuperCOT-30b
Quanitized using commit
df77083
of GPTA-for-LLaMa with the following settings:
wikitext2 --wbits 4 --true-sequential --act-order --save_safetensors
Tested in oobabooga using the GPTQ triton branch. No guarantees on compatibility.
license: other
