Views
No views yet
1pip install "sglang>=0.5.12"
2
3SGLANG_ENABLE_SPEC_V2=1 python3 -m sglang.launch_server --model-path Qwen/Qwen3.6-27B --speculative-algorithm EAGLE3 --speculative-draft-model-path ./compressed --speculative-num-steps 3 --speculative-eagle-topk 1 --speculative-num-draft-tokens 4 --mamba-scheduler-strategy extra_buffer --mm-attention-backend sdpa --dtype bfloat16 --trust-remote-code