Views
No views yet

| File | Quant | Size | Notes |
|---|---|---|---|
openthaigpt1.5-7b-instruct.Q4_K_M.gguf | Q4_K_M | ~4.7 GB | Recommended. Runs on 8 GB of RAM or a small GPU. |
openthaigpt1.5-7b-instruct.Q5_K_M.gguf | Q5_K_M | ~5.4 GB | Better quality, still laptop-friendly. |
openthaigpt1.5-7b-instruct.Q8_0.gguf | Q8_0 | ~8.1 GB | Near-lossless. |
ollama run hf.co/openthaigpt/openthaigpt1.5-7b-instruct-GGUF:Q4_K_M1llama-cli -m openthaigpt1.5-7b-instruct.Q4_K_M.gguf \
2 -p "ช่วยสรุปข้อดีข้อเสียของรถยนต์ไฟฟ้าในบริบทประเทศไทย" -n 2048 --temp 0.7<|im_start|> / <|im_end|>), embedded in the
GGUF. Recommended sampling: temperature=0.7, top_p=0.9.1@misc{yuenyong2024openthaigpt15thaicentric,
2 title={OpenThaiGPT 1.5: A Thai-Centric Open Source Large Language Model},
3 author={Sumeth Yuenyong and Kobkrit Viriyayudhakorn and Apivadee Piyatumrong and Jillaphat Jaroenkantasima},
4 year={2024},
5 eprint={2411.07238},
6 archivePrefix={arXiv},
7 primaryClass={cs.CL},
8 url={https://arxiv.org/abs/2411.07238}
9}