You can deploy this model and start earning money today!

rbarohit/
gemma3-4b-content-ft-merged-8bit

Name: gemma3-4b-content-ft-merged-8bit
Availability: InStock

safetensors

gemma3

Views

No views yet

Gemma 3 4B — Content FT (Merged 8-bit)

Format: Transformers (PyTorch) merged 8-bit
Source: Fine-tuned with Unsloth; LoRA merged back into base
Intended use: Inference with transformers + bitsandbytes

python

from transformers import AutoModelForCausalLM, AutoTokenizer
import torch

repo = "rbarohit/gemma3-4b-content-ft-merged-8bit"
tok = AutoTokenizer.from_pretrained(repo)
model = AutoModelForCausalLM.from_pretrained(
    repo,
    device_map="auto",
    torch_dtype=torch.float16,
    load_in_8bit=True,
)