Views
No views yet
| Generic Gemma 4 | MentalBridge |
|---|---|
| "Here are 5 tips: 1) Exercise 2) Sleep..." | "That feeling of wanting to disappear before facing them — I understand why every step toward home feels impossible right now." |
| Gives American crisis numbers | Routes to iCall 9152987821 and Vandrevala Foundation |
| Western therapy language | Understands IIT pressure, CA failures, arranged marriage |
| English only | Responds naturally in Tamil, Hindi, Telugu |
1from unsloth import FastLanguageModel
2
3model, tokenizer = FastLanguageModel.from_pretrained(
4 "vishnuprasadgs/mentalbridge-gemma4-E2B-finetuned",
5 max_seq_length=512,
6 load_in_4bit=True,
7)
8FastLanguageModel.for_inference(model)
9
10messages = [{"role": "user", "content": "I failed my CA exam and can't face my parents."}]
11inputs = tokenizer.apply_chat_template(messages, return_tensors="pt").to("cuda")
12outputs = model.generate(input_ids=inputs, max_new_tokens=150, temperature=0.7)
13print(tokenizer.decode(outputs[0][inputs.shape[1]:], skip_special_tokens=True))