Views
No views yet
| Benchmark | DeepSeek-V4-Pro-0813 | DeepSeek-V4-Flash-0731 | DeepSeek-V4-Pro (Preview) | DeepSeek-V4-Flash (Preview) | GLM-5.2 | Kimi K3 | Opus-4.8 | Fable-5 (w/ fallback) |
|---|---|---|---|---|---|---|---|---|
| HLE (wo / w tools) | 42.7 / 60.0 | 37.8 / 51.5 | 37.7 / 48.2 | 34.8 / 45.1 | 40.5 / 54.7 | 43.5 / 56.0 | 49.8 / 57.9 | 53.3 / 63.0 |
| Terminal Bench 2.1 | 87.9 | 82.7 | 72.1 | 61.8 | 81.0 | 88.3 | 85.0 | 88.0 |
| NL2Repo | 61.5 | 54.2 | 38.5 | 39.4 | 48.9 | - | 69.7 | - |
| Cybergym | 83.3 | 76.7 | 52.7 | 38.7 | - | 80.0 | 78.3 | 83.1 |
| DeepSWE | 62.7 | 54.4 | 12.8 | 7.3 | 46.2 | 67.5 | 58.0 | 70.0 |
| Toolathlon-Verified | 74.1 | 70.3 | 55.9 | 49.7 | 59.9 | 76.5 | 76.2 | 77.9 |
| Agents' Last Exam | 25.7 | 25.2 | 16.5 | 15.8 | 23.8 | 27.6 | 25.7 | - |
| AutomationBench (Public) | 31.8 | 25.1 | 12.8 | 10.8 | 12.9 | 30.8 | 27.2 | 29.1 |
| DSBench-FullStack † | 71.1 | 68.7 | 41.8 | 37.0 | 61.8 | 73.7 | 71.6 | 77.2 |
| DSBench-Hard † | 67.2 | 59.6 | 31.1 | 25.8 | 54.5 | 63.0 | 71.7 | 68.3 |
max reasoning effort level with temperature = 1.0, top_p = 0.95.encoding folder with Python scripts and test cases demonstrating how to encode messages in OpenAI-compatible format into input strings for the model, and how to parse the model's text output. Please refer to the encoding folder for full documentation.reasoning_effort parameter now supports three levels — low, high, and max — which control how much deliberation the model spends before answering.1from encoding_dsv4 import encode_messages, parse_message_from_completion_text
2
3messages = [
4 {"role": "user", "content": "hello"},
5 {"role": "assistant", "content": "Hello! I am DeepSeek.", "reasoning_content": "thinking..."},
6 {"role": "user", "content": "1+1=?"}
7]
8
9# messages -> string
10prompt = encode_messages(messages, thinking_mode="thinking", reasoning_effort="max")
11
12# string -> tokens
13import transformers
14tokenizer = transformers.AutoTokenizer.from_pretrained("deepseek-ai/DeepSeek-V4-Pro-0813")
15tokens = tokenizer.encode(prompt)--speculative-config '{"method":"dspark","num_speculative_tokens":7,"draft_sample_method":"greedy"}'1vllm serve deepseek-ai/DeepSeek-V4-Pro-0813 \
2 --trust-remote-code --kv-cache-dtype fp8 --block-size 256 \
3 --data-parallel-size 4 --enable-expert-parallel \
4 --moe-backend deep_gemm_mega_moe \
5 --attention-config '{"use_fp4_indexer_cache": true}' \
6 --speculative-config '{"method":"dspark","num_speculative_tokens":7,"draft_sample_method":"greedy"}'--speculative-algorithm DSPARK and do not set a separate --speculative-draft-model-path as the target and draft weights therefore come from the same checkpoint.
See the SGLang cookbook for detailed instructions, benchmarks and other hardwares configurations.1sglang serve \
2 --trust-remote-code \
3 --model-path deepseek-ai/DeepSeek-V4-Pro-0813 \
4 --tp 4 \
5 --moe-runner-backend flashinfer_mxfp4 \
6 --speculative-algorithm DSPARK \
7 --mem-fraction-static 0.90 \
8 --chunked-prefill-size 4096 \
9 --swa-full-tokens-ratio 0.1 \temperature = 1.0, with top_p = 0.95 for agentic scenarios and top_p = 1.0 otherwise. For the high and max reasoning effort levels, we recommend a maximum output length of 384K tokens.@misc{deepseekai2026deepseekv4,
title={DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligence},
author={DeepSeek-AI},
year={2026},
}