You can deploy this model and start earning money today!

RichardErkhov/
Praneeth_-_code-gemma-2b-it-8bits

Name: Praneeth_-_code-gemma-2b-it-8bits
Availability: InStock

safetensors

Views

No views yet

Quantization made by Richard Erkhov.

Github

Discord

Request more models

code-gemma-2b-it - bnb 8bits

Model creator: https://huggingface.co/Praneeth/
Original model: https://huggingface.co/Praneeth/code-gemma-2b-it/

Original model description:

language:

en license: other library_name: transformers tags:
peft
unsloth
lora
trl
sft datasets:
HuggingFaceH4/CodeAlpaca_20K license_name: gemma-terms-of-use license_link: https://ai.google.dev/gemma/terms

inference: false

Code-Gemma-2B

Description

Code-Gemma was finetuned (1k steps) on the CodeAlpaca-20k dataset using the unsloth library to enhance the Gemma-2B-it model.

Usage

Below we share some code snippets on how to get quickly started with running the model.

python

!pip install "unsloth[colab-new] @ git+https://github.com/unslothai/unsloth.git"
if major_version >= 8:
    # Use this for new GPUs like Ampere, Hopper GPUs (RTX 30xx, RTX 40xx, A100, H100, L40)
    !pip install --no-deps packaging ninja einops flash-attn xformers trl peft accelerate bitsandbytes
else:
    # Use this for older GPUs (V100, Tesla T4, RTX 20xx)
    !pip install --no-deps xformers trl peft accelerate bitsandbytes
pass

Running the model on a GPU using different precisions

Using torch.float16