Views
No views yet

sglang>=0.4.6.post1 or vllm>=0.8.5 or to create an OpenAI-compatible API endpoint:python -m sglang.launch_server --model-path Cylingo/Xinyuan-LLM-14B-0428 vllm serve Cylingo/Xinyuan-LLM-14B-0428 [!NOTE] For non-thinking mode, we suggest usingTemperature=0.8,TopP=0.8,TopK=20, andMinP=0. For more detailed guidance, please refer to the Best Practices section.
[!NOTE] All the notable open-source frameworks implement static YaRN, which means the scaling factor remains constant regardless of input length, potentially impacting performance on shorter texts. We advise adding therope_scalingconfiguration only when processing long contexts is required. It is also recommended to modify thefactoras needed. For example, if the typical context length for your application is 65,536 tokens, it would be better to setfactoras 2.0.
[!NOTE] Xinyuan-LLM-14B-0428 does not include a hybrid mode for Thinking similar to Qwen3. For now, we recommend that users stick to the standard mode. We plan to gradually introduce related features to the community in the future.