| model_name | model_size | ALL | MedQA_Mainland | PromptCBLUE | webMedQA |
|---|---|---|---|---|---|
| GPT4 | 220B*8(?) | 1195 | 1087 | 1134 | 1107 |
| ChatGPT | 175B(?) | 1123 | 1053 | 1089 | 1067 |
| PULSE_7b with prompt | 7B | 1074 | 1019 | 1047 | 1060 |
| PULSE_14b | 14B | 1055 | 1001 | 1037 | 1056 |
| PULSE_7b | 7B | 1054 | 1028 | 1037 | 1030 |
| BianQue | 6B | 926 | 939 | 920 | 1011 |
| QiZhenGPT | 13B | 918 | 949 | 935 | 974 |
| Med-ChatGLM | 6B | 864 | 988 | 921 | 859 |
| BenTsao | 7B | 846 | 966 | 913 | 859 |
| DoctorGLM | 6B | 812 | 935 | 891 | 856 |
| 量化等级 | 加载模型 |
|---|---|
| FP16 | 14GB |
1git clone https://github.com/openmedlab/PULSE
2cd PULSE1conda env create -f llm.yml
2conda activate llmtorch和transformers版本不建议低于推荐版本。python web_demo_gradio.pycli_demo.py来启动一个简单的命令行Demo：python cli_demo.py