Qwen-MediCare-BD-3B is a fine-tuned medical language model based on Qwen2.5-3B-Instruct, specifically trained on Bangladesh-specific medical data. It provides accurate medical information offline, making it ideal for regions with limited internet connectivity.
1from transformers import AutoModelForCausalLM, AutoTokenizer
2
3model = AutoModelForCausalLM.from_pretrained(
4 "CBrootA/Qwen-MediCare-BD",
5 device_map="auto",
6 load_in_4bit=True
7)
8tokenizer = AutoTokenizer.from_pretrained("CBrootA/Qwen-MediCare-BD")
9
10messages = [
11 {"role": "system", "content": "You are a medical assistant for Bangladesh."},
12 {"role": "user", "content": "What are dengue symptoms?"}
13]
14
15inputs = tokenizer.apply_chat_template(messages, return_tensors="pt").to("cuda")
16outputs = model.generate(inputs, max_new_tokens=256)
17response = tokenizer.decode(outputs[0], skip_special_tokens=True)