gemma-2-9b-gguf is a GGUF Q4_K_M int4 quantized version of Google's Gemma-2-9B with Instruct Training (IT), providing a very fast, very small inference implementation, optimized for AI PCs.

gemma-2-9b-gguf is a leading open source foundation model from Google.

Model Description

Developed by: Google
Model type: gemma-2-9b
Parameters: 9 billion
Model Parent: google/gemma-2-9b-it
Language(s) (NLP): English
License: Apache 2.0
Uses: General purpose chat
RAG Benchmark Accuracy Score: NA
Quantization: int4

Model Card Contact

llmware on github

llmware on hf

llmware website

llmware/gemma-2-9b-instruct-gguf

gemma-2-9b-gguf

Model Description

Model Card Contact

llmware/
gemma-2-9b-instruct-gguf