This model is fined tune based on Google's Gemma model for creating virtual doctor or medical Asistant. It can be used in medical and healthcare AI assitant apps and chatbots.

Developed by: [Ali Bidaran]

Uses

python

import torch
from transformers import AutoTokenizer, AutoModelForCausalLM, BitsAndBytesConfig, GemmaTokenizer

model_id = "alibidaran/Gemma2_Virtual_doctor"
bnb_config = BitsAndBytesConfig(
    load_in_4bit=True,
    bnb_4bit_quant_type="nf4",
    bnb_4bit_compute_dtype=torch.bfloat16
)


tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(model_id, quantization_config=bnb_config, device_map={"":0})

prompt = " Hi doctor, I feel a pain on my ankle, I walk hardly and with pain what do you recommend me?"
text=f"<s> ###Human: {prompt} ###Asistant: "
inputs=tokenizer(text,return_tensors='pt').to('cuda')
with torch.no_grad():
    outputs=model.generate(**inputs,max_new_tokens=200,do_sample=True,top_p=0.92,top_k=10,temperature=0.7)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))

Training Parameters

    per_device_train_batch_size=1,
    gradient_accumulation_steps=8,
    warmup_steps=2,
    #max_steps=200,
   
    num_train_epochs=1,
    learning_rate=2e-4,
    fp16=True,
    logging_steps=100,
    output_dir="outputs",
    optim="paged_adamw_8bit",
    save_steps=500,
    ddp_find_unused_parameters=False // for training on multiple GPU

RichardErkhov/alibidaran_-_Gemma2_Virtual_doctor-awq

Original model description:

Model Card for Model ID

Model Details

Model Description

Uses

Training Parameters

RichardErkhov/
alibidaran_-_Gemma2_Virtual_doctor-awq