Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
airoboros-13b-gpt4-1.4-GPTQ-32g-ao-ts – AI Model by TheYuriLover | AlphaNeural AI
You can deploy this model and start earning money today!
TheYuriLover
/
airoboros-13b-gpt4-1.4-GPTQ-32g-ao-ts
like
0
transformers
pytorch
llama
text-generation
autotrain_compatible
text-generation-inference
endpoints_compatible
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
This is the gptq 4bit quantization of this model:
https://huggingface.co/jondurbin/airoboros-13b-gpt4-1.4
This quantization was made by using this repository:
https://github.com/qwopqwop200/GPTQ-for-LLaMa/tree/triton
And I used the triton branch with all the gptq implementations available (true_sequential + act_order + groupsize 32)
