You can deploy this model and start earning money today!

lmsys/
DeepSeek-V3-0324-NextN

Name: DeepSeek-V3-0324-NextN
Availability: InStock

Views

No views yet

DeepSeek-V3-0324-NextN

NextN layer exported from deepseek-ai/DeepSeek-V3-0324 model with script. Used for speculative decoding in SGLang.

Usage

python3 -m sglang.launch_server --model deepseek-ai/DeepSeek-V3-0324 --speculative-algo EAGLE --speculative-draft lmsys/DeepSeek-V3-0324-NextN --speculative-num-steps 2 --speculative-eagle-topk 4 --speculative-num-draft-tokens 4 --trust-remote --tp 8