Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
Doctor-Shotgun_Nous-Capybara-limarpv3-34B-4.2bpw-h6-exl2 – AI Model by MarinaraSpaghetti | AlphaNeural AI
You can deploy this model and start earning money today!
MarinaraSpaghetti
/
Doctor-Shotgun_Nous-Capybara-limarpv3-34B-4.2bpw-h6-exl2
like
0
transformers
safetensors
llama
text-generation
roleplay
text-generation-inference
lemonilia/LimaRP
autotrain_compatible
endpoints_compatible
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
Model Card for Model ID
My first exl2 quant of my favourite go-to roleplaying model. Can fit into my empty 24GB VRAM with 32k context in 8-bit cache. Might do a 4.25bpw quant later.
Original model:
https://huggingface.co/Doctor-Shotgun/Nous-Capybara-limarpv3-34B
Prompt format:
https://github.com/tatsu-lab/stanford_alpaca
