Model Card for Model ID

UPDATE

2024.01.10

• Asclepius-R, the variant of Asclepius that trained on MIMIC-III discharge summaries, is now available on Physionet!

Model Details

Model Description

• Model type: Clinical LLM (Large Language Model)
• Language(s) (NLP): English
• License: CC-BY-NC-SA 4.0
• Finetuned from model: Llama2-13B

Model Sources

• Repository: https://github.com/starmpcc/Asclepius
• Paper: https://arxiv.org/abs/2309.00237
• Data: https://huggingface.co/datasets/starmpcc/Asclepius-Synthetic-Clinical-Notes

Uses

Out-of-Scope Use

How to Get Started with the Model

Training Details

Training Data

Training Procedure

• Causal language modeling on synthetic clinical notes.

Training Hyperparameters

• We followed config used in Stanford Alpaca

Speeds, Sizes, Times

• Pre-Training (1 epoch): 1h 58m with 8x A100 80G

Citation

@misc{kweon2023publicly,
    title={Publicly Shareable Clinical Large Language Model Built on Synthetic Clinical Notes},
    author={Sunjun Kweon and Junu Kim and Jiyoun Kim and Sujeong Im and Eunbyeol Cho and Seongsu Bae and Jungwoo Oh and Gyubok Lee and Jong Hak Moon and Seng Chan You and Seungjin Baek and Chang Hoon Han and Yoon Bin Jung and Yohan Jo and Edward Choi},
    year={2023},
    eprint={2309.00237},
    archivePrefix={arXiv},
    primaryClass={cs.CL}
}