valenradovich/
gemma-2-9b-it-Q4_0-gguf

Original Model: <a href="https://huggingface.co/google/gemma-2-9b-it" target="_blank" rel="noopener noreferrer" class="text-blue-400 hover:text-blue-300 underline underline-offset-2 transition-colors">Gemma2-9B-it
Quantization Method: Q4_0
Precision: 4-bit

Name: gemma-2-9b-it-Q4_0-gguf
Availability: InStock

like

0

Views

No views yet

gemma-2-9B-it-q4_0

This is a quantized version of the Gemma2 9B instruct model using the Q4_0 quantization method.

You can use it directly with llama.cpp