These are applied automatically when a request omits sampling params. Override per-request as needed.
Serving (2× DGX Spark GB10, tensor-parallel-2)
Requires the DeepSeek-V4 vLLM path for sm_121 (e.g. the jasl/vllm GB10 build). Head + worker
over a RoCE point-to-point link, TP=2 + expert-parallel, fp8 KV cache, DSpark spec-decode, 384K ctx.
See the included serve/ scripts. Key flags:
Controllable thinking (low / high / max) via the reasoning system preface; the reasoning trace is
returned as reasoning_content, the answer as content. Note: thinking mode reasons at length —
allow ≥2500 output tokens or the answer may be truncated.
Tools
DeepSeek-V4 tool-call parser; pass OpenAI-style tools to the chat endpoint.
License
MIT (inherits the upstream DeepSeek-V4-Flash license terms). Review before use.