Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
mistral-instruct0.2-imatrix4bit.gguf – AI Model by nisten | AlphaNeural AI
You can deploy this model and start earning money today!
nisten
/
mistral-instruct0.2-imatrix4bit.gguf
like
0
mistralai/Mistral-7B-Instruct-v0.2
quantized
conversational
endpoints_compatible
gguf
template
apache-2.0
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
Base model:
https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2
This is just a custom 4bit imatrix quant made to run optiomally on a macbook with 8gb of ram.
For use with llama.cpp
https://github.com/ggerganov/llama.cpp
