Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
miqu-1-70b-sf-exl2-2-4.65b – AI Model by matatonic | AlphaNeural AI
You can deploy this model and start earning money today!
matatonic
/
miqu-1-70b-sf-exl2-2-4.65b
like
0
transformers
llama
text-generation
conversational
autotrain_compatible
endpoints_compatible
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
from: [
https://huggingface.co/miqudev/miqu-1-70b
]
to: [
https://huggingface.co/152334H/miqu-1-70b-sf
]
quantized as: 4.65bpw exl2 with exllamav2 v0.0.13
chat template with system prompt support included.
Works with 48GB and FP8 cache @ 32k context in TabbyAPI