You can deploy this model and start earning money today!

RichardErkhov/
bharadwajswarna_-_gemma-2b-sft-telugu-gguf

Name: bharadwajswarna_-_gemma-2b-sft-telugu-gguf
Availability: InStock

endpoints_compatible

gguf

template

Views

No views yet

Quantization made by Richard Erkhov.

Github

Discord

Request more models

gemma-2b-sft-telugu - GGUF

Model creator: https://huggingface.co/bharadwajswarna/
Original model: https://huggingface.co/bharadwajswarna/gemma-2b-sft-telugu/

Name	Quant method	Size
gemma-2b-sft-telugu.Q2_K.gguf	Q2_K	1.08GB
gemma-2b-sft-telugu.IQ3_XS.gguf	IQ3_XS	1.16GB
gemma-2b-sft-telugu.IQ3_S.gguf	IQ3_S	1.2GB
gemma-2b-sft-telugu.Q3_K_S.gguf	Q3_K_S	1.2GB
gemma-2b-sft-telugu.IQ3_M.gguf	IQ3_M	1.22GB
gemma-2b-sft-telugu.Q3_K.gguf	Q3_K	1.29GB
gemma-2b-sft-telugu.Q3_K_M.gguf	Q3_K_M	1.29GB
gemma-2b-sft-telugu.Q3_K_L.gguf	Q3_K_L	1.36GB
gemma-2b-sft-telugu.IQ4_XS.gguf	IQ4_XS	1.4GB
gemma-2b-sft-telugu.Q4_0.gguf	Q4_0	1.44GB
gemma-2b-sft-telugu.IQ4_NL.gguf	IQ4_NL	1.45GB
gemma-2b-sft-telugu.Q4_K_S.gguf	Q4_K_S	1.45GB
gemma-2b-sft-telugu.Q4_K.gguf	Q4_K	1.52GB
gemma-2b-sft-telugu.Q4_K_M.gguf	Q4_K_M	1.52GB
gemma-2b-sft-telugu.Q4_1.gguf	Q4_1	1.56GB
gemma-2b-sft-telugu.Q5_0.gguf	Q5_0	1.68GB
gemma-2b-sft-telugu.Q5_K_S.gguf	Q5_K_S	1.68GB
gemma-2b-sft-telugu.Q5_K.gguf	Q5_K	1.71GB
gemma-2b-sft-telugu.Q5_K_M.gguf	Q5_K_M	1.71GB
gemma-2b-sft-telugu.Q5_1.gguf	Q5_1	1.79GB
gemma-2b-sft-telugu.Q6_K.gguf	Q6_K	1.92GB
gemma-2b-sft-telugu.Q8_0.gguf	Q8_0	2.49GB

Original model description:

license: apache-2.0

Baby Nandi

Baby Nandi (part of the Nandi series of Telugu LLMs) is a Telugu Instruction Tuned Version of Gemma 2B, part of an attempt to develop smaller and efficient Indic LLMs, useful for practical purposes. It beats the original gemma-2b overall, but still is behind the latest gemma-2b-1.1-it.

🏆 Benchmarks

Model	Average	AGIEval	GPT4All	TruthfulQA	Bigbench
bharadwajswarna/gemma-2b-sft-telugu 📄	38.99	21.53	55.56	48.33	30.56
google/gemma-2b-it 📄	36.1	23.76	43.6	47.64	29.41
google/gemma-2b 📄	34.26	22.7	43.35	39.96	31.03

Training Process & Datasets :

Gemma 2b Base model has been further pretrained on a part of AI4Bharat Sangraha dataset (280k Telugu Samples).
SFT on a mix of Telugu Alpaca + Telugu GPTeacher from Telugu LLM Labs and English Alpaca

You can find the link to this model here : Gemma-2b-Telugu-Base-Model

Training Duration :

Pretraining for 6 epochs, nearly 35 hours (This might not be enough)
SFT for 3 epochs

Inference Prompt Template:

"""
### Instruction:
{}

### Input:
{}

### Response:
{}
"""

Developer : Bharadwaj Swarna
You can reach out to me for any questions/suggestions/collaborations.

RichardErkhov/bharadwajswarna_-_gemma-2b-sft-telugu-gguf

Original model description:

license: apache-2.0

Baby Nandi

RichardErkhov/
bharadwajswarna_-_gemma-2b-sft-telugu-gguf