Views
No views yet
1{
2 "messages": [{"role": "user", "content": "..."}],
3 "chat_template_kwargs": {"enable_thinking": true},
4 "max_tokens": 8192
5}enable_thinking=True 필수max_tokens >= 8192 권장 (충분한 추론 공간 확보)1vllm serve FINAL-Bench/JGOS-31B-Citizen-R \
2 --served-model-name JGOS-31B-Citizen-R \
3 --max-model-len 16384 --trust-remote-code \
4 --limit-mm-per-prompt '{"image":0,"video":0}'