Finetuned from model [optional]: unsloth/DeepSeek-R1-Distill-Llama-8B
How to Get Started with the Model
question = """A patient with acute appendicitis has been
ill for 5 days, with slightly relieved abdominal pain
but still feverish.
A tender mass was found in the lower right abdomen
during a physical examination. How should this be handled at this point?
"""
FastLanguageModel.for_inference(model) # Unsloth has 2x faster inference!
inputs = tokenizer([prompt_style.format(question, "")],
return_tensors="pt").to("cuda")
from transformers import TextStreamer
text_streamer = TextStreamer(tokenizer)
_ = model.generate(**inputs, streamer=text_streamer, max_new_tokens=2048)
```python
[More Information Needed]
## Training Details
### Training Data
[FreedomIntelligence/medical-o1-reasoning-SFT](https://huggingface.co/datasets/FreedomIntelligence/medical-o1-reasoning-SFT)
#### Preprocessing [optional]
train_prompt_style = """Below is an instruction that describes a task, paired with an input that provides further context.
Write a response that appropriately completes the request.
Before answering, think carefully about the question and create a step-by-step chain of thoughts to ensure a logical and accurate response.
Instruction:
You are a medical expert with advanced knowledge in clinical reasoning, diagnostics, and treatment planning.
Please answer the following medical question.
Question:
{}
Response:
{}
{}"""
python
1234#### Training Hyperparameters56-**Training regime:**7- fp16
8- optim="adamw_8bit",9- weight_decay=0.01,10- lr_scheduler_type="linear",11- per_device_train_batch_size=2,12- gradient_accumulation_steps=4,13- warmup_steps=5,14- max_steps=60,15- learning_rate=1e-4,1617[More Information Needed]1819202122#### Summary23This is fine tuned model on Medical dataset with Deepseek llama 3-8b distill
2425#### Hardware2627nvidia L4
2829## Model Card Authors [optional]3031Melody Zhao
3233## Model Card Contact3435[Github](https://github.com/Melody-coder923)
