This repository provides the LoRA adapter for an experimental Gemma 4 E2B
fine-tune on
google/mobile-actions.
The merged model produced from this adapter was evaluated on 200 held-out
examples from google/mobile-actions (metadata == "eval").
1import torch
2from peft import PeftModel
3from transformers import AutoModelForCausalLM, AutoProcessor
4
5base_model = "google/gemma-4-E2B-it"
6adapter_id = "YOUR_USERNAME/gemma4-e2b-mobile-actions-200-lora"
7
8processor = AutoProcessor.from_pretrained(adapter_id)
9model = AutoModelForCausalLM.from_pretrained(
10 base_model,
11 dtype=torch.bfloat16,
12 device_map="auto",
13)
14model = PeftModel.from_pretrained(model, adapter_id)
1python examples/run_lora.py \
2 --adapter-id ClarkBear/gemma4-e2b-mobile-actions-200-lora \
3 --prompt "Turn on the flashlight"
This is an experimental small-data LoRA adapter. It was trained on only 200
examples and should be evaluated before use in production or on-device
workflows.