You can deploy this model and start earning money today!

kerasformers/
gemma-7b-it

Name: gemma-7b-it
Availability: InStock

Views

No views yet

See our collection for all versions of Gemma.

Run Gemma with Keras 3: JAX, PyTorch, or TensorFlow

GitHub

zeromodels/gemma-7b-it

Paper: Gemma: Open Models Based on Gemini Research and Technology (arXiv:2403.08295) · HF Papers

Gemma is Google's open decoder-only LLM family (RMSNorm, GeGLU, RoPE, multi-query attention). Base checkpoints are for completion; -it / 1.1 variants are instruction-tuned for chat.

For more details on the model, please go to Google's original model card.

Pure-Keras 3 conversion of google/gemma-7b-it for zeromodels. One implementation runs unmodified on TensorFlow / Torch / JAX.

This is an instruction-tuned checkpoint: use the chat template via GemmaTokenizer.

✨ Quick start

python

import os
os.environ["KERAS_BACKEND"] = "torch"  # or "jax" / "tensorflow"

from zeromodels.models.gemma import GemmaTextGenerate, GemmaTokenizer

model = GemmaTextGenerate.from_weights("zeromodels/gemma-7b-it")
tokenizer = GemmaTokenizer.from_weights("zeromodels/gemma-7b-it")

inputs = tokenizer([
    {"role": "user", "content": "Explain rotary embeddings in one sentence."}
])
outputs = model.generate(**inputs, max_new_tokens=64)
print(tokenizer.decode(outputs[0]))

Load any Gemma v1 variant the same way with from_weights("zeromodels/<variant>"):

Variant	Hub	Type
`gemma-2b`	`zeromodels/gemma-2b`	base
`gemma-2b-it`	`zeromodels/gemma-2b-it`	instruct
`gemma-1.1-2b-it`	`zeromodels/gemma-1.1-2b-it`	instruct (1.1)
`gemma-7b`	`zeromodels/gemma-7b`	base
`gemma-7b-it`	`zeromodels/gemma-7b-it`	instruct
`gemma-1.1-7b-it`	`zeromodels/gemma-1.1-7b-it`	instruct (1.1)

Tips

Set KERAS_BACKEND before importing Keras / zeromodels.
Prefer GemmaTokenizer.from_weights(...) so the chat template matches.
Larger checkpoints: try load_dtype="bfloat16" or quantization="int8".
See Gemma docs and Loading Weights.
Community / upstream safetensors still work via the hf: prefix, e.g. GemmaTextGenerate.from_weights("hf:google/gemma-7b-it").

Special Thanks

A huge thank you to the Google Gemma authors for creating and releasing these models.

License: Gemma (gated). Accept the license on the upstream Hub card before downloading.

kerasformers/gemma-7b-it