Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
gemma-2-9b-it-IQ1_M-gguf – AI Model by valenradovich | AlphaNeural AI
You can deploy this model and start earning money today!
valenradovich
/
gemma-2-9b-it-IQ1_M-gguf
like
0
conversational
endpoints_compatible
gguf
imatrix
template
apache-2.0
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
gemma-2-9B-it-iq1_m
This is a quantized version of the Gemma2 9B instruct model using the IQ1_M quantization method.
Model Details
Original Model
:
Gemma2-9B-it
Quantization Method
: IQ1_M
Precision
: 1-bit
iMatrix
: From
bartowski
. You can find the file in the following repo;
gemma-2-9b-it-gguf repo
Usage
You can use it directly with llama.cpp
