You can deploy this model and start earning money today!

RichardErkhov/
kadirnar_-_turkish-gemma2b-v0-exl2

Name: kadirnar_-_turkish-gemma2b-v0-exl2
Availability: InStock

Views

No views yet

Quantization made by Richard Erkhov.

turkish-gemma2b-v0 - EXL2

Available sizes

Branch	Bits	Description
8_0	8.0	Maximum quality that ExLlamaV2 can produce, near unquantized performance.
6_5	6.5	Very similar to 8.0, good tradeoff of size vs performance, recommended.
5_0	5.0	Slightly lower quality vs 6.5, but usable
4_25	4.25	GPTQ equivalent bits per weight, slightly higher quality.
3_5	3.5	Lower quality, only use if you have to.

With git:

git clone --single-branch --branch 6_5 https://huggingface.co/kadirnar_-_turkish-gemma2b-v0-exl2 turkish-gemma2b-v0-6_5

With huggingface hub:

pip3 install huggingface-hub

To download a specific branch, use the --revision parameter. For example, to download the 6.5 bpw branch: Linux:

huggingface-cli download kadirnar_-_turkish-gemma2b-v0-exl2 --revision 6_5 --local-dir turkish-gemma2b-v0-6_5 --local-dir-use-symlinks False

Windows (which apparently doesn't like _ in folders sometimes?):

huggingface-cli download kadirnar_-_turkish-gemma2b-v0-exl2 --revision 6_5 --local-dir turkish-gemma2b-v0-6.5 --local-dir-use-symlinks False

base_model: unsloth/gemma-2-2b language:

This gemma2 model was trained 2x faster with Unsloth and Huggingface's TRL library.