You can deploy this model and start earning money today!

RichardErkhov/
ruslanmv_-_Medical-Llama3-8B-gguf

Name: ruslanmv_-_Medical-Llama3-8B-gguf
Availability: InStock

endpoints_compatible

gguf

template

Views

No views yet

Quantization made by Richard Erkhov.

Github

Discord

Request more models

Medical-Llama3-8B - GGUF

Model creator: https://huggingface.co/ruslanmv/
Original model: https://huggingface.co/ruslanmv/Medical-Llama3-8B/

Name	Quant method	Size
Medical-Llama3-8B.Q2_K.gguf	Q2_K	2.96GB
Medical-Llama3-8B.IQ3_XS.gguf	IQ3_XS	3.28GB
Medical-Llama3-8B.IQ3_S.gguf	IQ3_S	3.43GB
Medical-Llama3-8B.Q3_K_S.gguf	Q3_K_S	3.41GB
Medical-Llama3-8B.IQ3_M.gguf	IQ3_M	3.52GB
Medical-Llama3-8B.Q3_K.gguf	Q3_K	3.74GB
Medical-Llama3-8B.Q3_K_M.gguf	Q3_K_M	3.74GB
Medical-Llama3-8B.Q3_K_L.gguf	Q3_K_L	4.03GB
Medical-Llama3-8B.IQ4_XS.gguf	IQ4_XS	4.18GB
Medical-Llama3-8B.Q4_0.gguf	Q4_0	4.34GB
Medical-Llama3-8B.IQ4_NL.gguf	IQ4_NL	4.38GB
Medical-Llama3-8B.Q4_K_S.gguf	Q4_K_S	4.37GB
Medical-Llama3-8B.Q4_K.gguf	Q4_K	4.58GB
Medical-Llama3-8B.Q4_K_M.gguf	Q4_K_M	4.58GB
Medical-Llama3-8B.Q4_1.gguf	Q4_1	4.78GB
Medical-Llama3-8B.Q5_0.gguf	Q5_0	5.21GB
Medical-Llama3-8B.Q5_K_S.gguf	Q5_K_S	5.21GB
Medical-Llama3-8B.Q5_K.gguf	Q5_K	5.34GB
Medical-Llama3-8B.Q5_K_M.gguf	Q5_K_M	5.34GB
Medical-Llama3-8B.Q5_1.gguf	Q5_1	5.65GB
Medical-Llama3-8B.Q6_K.gguf	Q6_K	6.14GB
Medical-Llama3-8B.Q8_0.gguf	Q8_0	7.95GB

Original model description:

language: en license: apache-2.0 tags:

text-generation-inference
transformers
ruslanmv
llama
trl
llama-3
instruct
finetune
chatml
DPO
RLHF
gpt4
distillation
heathcare
medical
clinical
med
lifescience
Pharmaceutical
Pharma base_model: meta-llama/Meta-Llama-3-8B datasets:
ruslanmv/ai-medical-chatbot

model-index:

name: Medical-Llama3-8B results: [] widget:
example_title: Medical-Llama3-8B messages:
- role: system content: >- You are an expert and experienced from the healthcare and biomedical domain with extensive medical knowledge and practical experience.
- role: user content: How long does it take for newborn jaundice to go away? output: text: >- Newborn jaundice, also known as neonatal jaundice, is a common condition in newborns where the yellowing of the skin and eyes occurs due to an elevated level of bilirubin in the blood. Bilirubin is a yellow pigment that forms when red blood cells break down. In most cases, newborn jaundice resolves on its own without any specific treatment. The duration of newborn jaundice can vary depending on several factors such as the underlying cause, gestational age at birth, and individual variations in bilirubin metabolism. Here are some general guidelines

Medical-Llama3-8B-16bit: Fine-Tuned Llama3 for Medical Q&A

This repository provides a fine-tuned version of the powerful Llama3 8B model, specifically designed to answer medical questions in an informative way. It leverages the rich knowledge contained in the AI Medical Chatbot dataset (ruslanmv/ai-medical-chatbot).

Model & Development

Developed by: ruslanmv
License: Apache-2.0
Finetuned from model: meta-llama/Meta-Llama-3-8B

Key Features

Medical Focus: Optimized to address health-related inquiries.
Knowledge Base: Trained on a comprehensive medical chatbot dataset.
Text Generation: Generates informative and potentially helpful responses.

Installation

This model is accessible through the Hugging Face Transformers library. Install it using pip:

pip install transformers bitsandbytes accelerate

Usage Example

Here's a Python code snippet demonstrating how to interact with the Medical-Llama3-8B-16bit model and generate answers to your medical questions:

python

from transformers import AutoModelForCausalLM, AutoTokenizer, BitsAndBytesConfig
import torch
model_name = "ruslanmv/Medical-Llama3-8B"
device_map = 'auto'
bnb_config = BitsAndBytesConfig(load_in_4bit=True, bnb_4bit_quant_type="nf4",bnb_4bit_compute_dtype=torch.float16,)
model = AutoModelForCausalLM.from_pretrained( model_name,quantization_config=bnb_config, trust_remote_code=True,use_cache=False,device_map=device_map)
tokenizer = AutoTokenizer.from_pretrained(model_name, trust_remote_code=True)
tokenizer.pad_token = tokenizer.eos_token

def askme(question):
    sys_message = ''' 
    You are an AI Medical Assistant trained on a vast dataset of health information. Please be thorough and
    provide an informative answer. If you don't know the answer to a specific medical inquiry, advise seeking professional help.
    '''   
    # Create messages structured for the chat template
    messages = [{"role": "system", "content": sys_message}, {"role": "user", "content": question}]
    
    # Applying chat template
    prompt = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
    inputs = tokenizer(prompt, return_tensors="pt").to("cuda")
    outputs = model.generate(**inputs, max_new_tokens=100, use_cache=True)
    
    # Extract and return the generated text, removing the prompt
    response_text = tokenizer.batch_decode(outputs)[0].strip()
    answer = response_text.split('<|im_start|>assistant')[-1].strip()
    return answer
# Example usage
# - Context: First describe your problem.
# - Question: Then make the question.

question = '''I'm a 35-year-old male and for the past few months, I've been experiencing fatigue, 
increased sensitivity to cold, and dry, itchy skin. 
Could these symptoms be related to hypothyroidism? 
If so, what steps should I take to get a proper diagnosis and discuss treatment options?'''

print(askme(question))

the type of answer is :

Based on your description, it sounds like you may be experiencing symptoms of hypothyroidism. 
Hypothyroidism is a condition where the thyroid gland doesn't produce enough hormones, leading to a variety of symptoms. 
Some common symptoms include fatigue, weight gain, constipation, and dry skin. 
If you're experiencing any of these symptoms, it's important to see a doctor for a proper diagnosis and treatment plan. 
Your doctor may order blood tests to check your thyroid hormone levels

Important Note

This model is intended for informational purposes only and should not be used as a substitute for professional medical advice. Always consult with a qualified healthcare provider for any medical concerns.

License

This model is distributed under the Apache License 2.0 (see LICENSE file for details).

Contributing

We welcome contributions to this repository! If you have improvements or suggestions, feel free to create a pull request.

Disclaimer

While we strive to provide informative responses, the accuracy of the model's outputs cannot be guaranteed. It is crucial to consult a doctor or other healthcare professional for definitive medical advice.

RichardErkhov/ruslanmv_-_Medical-Llama3-8B-gguf

Original model description:

Medical-Llama3-8B-16bit: Fine-Tuned Llama3 for Medical Q&A

RichardErkhov/
ruslanmv_-_Medical-Llama3-8B-gguf