Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
story-reverse-prompt-70b-rope8-32K-6bpw_h6_exl2 – AI Model by grimulkan | AlphaNeural AI
You can deploy this model and start earning money today!
grimulkan
/
story-reverse-prompt-70b-rope8-32K-6bpw_h6_exl2
like
0
transformers
llama
text-generation
llama2
autotrain_compatible
endpoints_compatible
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
This is a 6-bit quantization of
Story Reverse Prompt 70B 32K
. See that page for more details.
This quantization fits in 48GB+24GB (36/24 split) or 3x24GB (16/17/20 split) using Exllamav2 @ 32k context.