🇹🇭 OpenThaiGPT 13b 1.0.0-beta Chat with 16 bits in Huggingface's format.

Licenses

Codes and Weight

Sponsors

Supports

• Official website: https://openthaigpt.aieat.or.th
• Facebook page: https://web.facebook.com/groups/openthaigpt
• A Discord server for discussion and support here
• E-mail: kobkrit@aieat.or.th

Description

<s>[INST] <<SYS>>
system_prompt
<</SYS>>

question [/INST]

How to use

1. install VLLM (https://github.com/vllm-project/vllm)
2. python -m vllm.entrypoints.api_server --model /path/to/model --tensor-parallel-size num_gpus
3. run inference (CURL example)

curl --request POST \
    --url http://localhost:8000/generate \
    --header "Content-Type: application/json" \
    --data '{"prompt": "<s>[INST] <<SYS>>\nYou are a question answering assistant. Answer the question as truthful and helpful as possible คุณคือผู้ช่วยตอบคำถาม จงตอบคำถามอย่างถูกต้องและมีประโยชน์ที่สุด\n<</SYS>>\n\nอยากลดความอ้วนต้องทำอย่างไร [/INST]","use_beam_search": false, "temperature": 0.1, "max_tokens": 512, "top_p": 0.75, "top_k": 40, "frequency_penalty": 0.3 "stop": "</s>"}'

Authors

• Kobkrit Viriyayudhakorn (kobkrit@aieat.or.th)
• Sumeth Yuenyong (sumeth.yue@mahidol.edu)
• Thaweewat Rugsujarit (thaweewr@scg.com)
• Jillaphat Jaroenkantasima (autsadang41@gmail.com)
• Norapat Buppodom (new@norapat.com)
• Koravich Sangkaew (kwankoravich@gmail.com)
• Peerawat Rojratchadakorn (peerawat.roj@gmail.com)
• Surapon Nonesung (nonesungsurapon@gmail.com)
• Chanon Utupon (chanon.utupon@gmail.com)
• Sadhis Wongprayoon (sadhis.tae@gmail.com)
• Nucharee Thongthungwong (nuchhub@hotmail.com)
• Chawakorn Phiantham (mondcha1507@gmail.com)
• Patteera Triamamornwooth (patt.patteera@gmail.com)
• Nattarika Juntarapaoraya (natt.juntara@gmail.com)
• Kriangkrai Saetan (kraitan.ss21@gmail.com)
• Pitikorn Khlaisamniang (pitikorn32@gmail.com)