Beta
Explore
Marketplace
Neural Labs
Playground
Wallet
Docs
airoboros-limarpv3-l2-70b-2.2.1-exl2 – AI Model by DS-Archive | AlphaNeural AI
You can deploy this model and start earning money today!
DS-Archive
/
airoboros-limarpv3-l2-70b-2.2.1-exl2
like
0
llama
llama-2
text-generation
en
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
airoboros-limarpv3-l2-70b-2.2.1-exl2
Exllama v2 quant of
Doctor-Shotgun/airoboros-limarpv3-l2-70b-2.2.1
Branches:
main: measurement.json calculated at 2048 token calibration rows on PIPPA
5.0bpw-h6: 5 decoder bits per weight, 6 head bits
ideal for 2x 24gb GPUs at 8192 context, or 1x 48gb GPU at 8192 context with CFG cache