Views
No views yet

| File | Quant | Size | Notes |
|---|---|---|---|
openthaigpt-1.6-72b-instruct.Q4_K_M.gguf | Q4_K_M | ~44 GB | Recommended. 2× 24 GB GPUs or a 64 GB Mac. |
openthaigpt-1.6-72b-instruct.Q5_K_M.gguf | Q5_K_M | ~51 GB | Higher quality. |
openthaigpt-1.6-72b-instruct.Q8_0.gguf | Q8_0 | ~77 GB | Near-lossless. |
ollama run hf.co/openthaigpt/openthaigpt-1.6-72b-instruct-GGUF:Q4_K_M1llama-cli -m openthaigpt-1.6-72b-instruct.Q4_K_M.gguf \
2 -p "เขียนฟังก์ชัน Python แปลงเลขไทยเป็นเลขอารบิก พร้อมอธิบายโค้ด" -n 2048 --temp 0.7<|im_start|> / <|im_end|>), embedded in the GGUF.
Recommended sampling: temperature=0.7, top_p=0.9.1@misc{yuenyong2025openthaigpt16r1thaicentric,
2 title={OpenThaiGPT 1.6 and R1: Thai-Centric Open Source and Reasoning Large Language Models},
3 author={Sumeth Yuenyong and Thodsaporn Chay-intr and Kobkrit Viriyayudhakorn},
4 year={2025},
5 eprint={2504.01789},
6 archivePrefix={arXiv},
7 primaryClass={cs.CL},
8 url={https://arxiv.org/abs/2504.01789}
9}