Views
No views yet

| Benchmark | Step 3.5 Flash | DeepSeek V3.2 | Kimi K2 Thinking / K2.5 | GLM-4.7 | MiniMax M2.1 | MiMo-V2 Flash |
|---|---|---|---|---|---|---|
| # Activated Params | 11B | 37B | 32B | 32B | 10B | 15B |
| # Total Params (MoE) | 196B | 671B | 1T | 355B | 230B | 309B |
| Est. decoding cost @ 128K context, Hopper GPU** | 1.0x 100 tok/s, MTP-3, EP8 | 6.0x 33 tok/s, MTP-1, EP32 | 18.9x 33 tok/s, no MTP, EP32 | 18.9x 100 tok/s, MTP-3, EP8 | 3.9x 100 tok/s, MTP-3, EP8 | 1.2x 100 tok/s, MTP-3, EP8 |
| Agent | ||||||
| τ²-Bench | 88.2 | 80.3 (85.2*) | 74.3*/85.4* | 87.4 | 86.6* | 80.3 (84.1*) |
| BrowseComp | 51.6 | 51.4 | 41.5* / 60.6 | 52.0 | 47.4 | 45.4 |
| BrowseComp (w/ Context Manager) | 69.0 | 67.6 | 60.2/74.9 | 67.5 | 62.0 | 58.3 |
| BrowseComp-ZH | 66.9 | 65.0 | 62.3 / 62.3* | 66.6 | 47.8* | 51.2* |
| BrowseComp-ZH (w/ Context Manager) | 73.7 | — | —/— | — | — | — |
| GAIA (no file) | 84.5 | 75.1* | 75.6*/75.9* | 61.9* | 64.3* | 78.2* |
| xbench-DeepSearch (2025.05) | 83.7 | 78.0* | 76.0*/76.7* | 72.0* | 68.7* | 69.3* |
| xbench-DeepSearch (2025.10) | 56.3 | 55.7* | —/40+ | 52.3* | 43.0* | 44.0* |
| ResearchRubrics | 65.3 | 55.8* | 56.2*/59.5* | 62.0* | 60.2* | 54.3* |
| Reasoning | ||||||
| AIME 2025 | 97.3 | 93.1 | 94.5/96.1 | 95.7 | 83.0 | 94.1 (95.1*) |
| HMMT 2025 (Feb.) | 98.4 | 92.5 | 89.4/95.4 | 97.1 | 71.0* | 84.4 (95.4*) |
| HMMT 2025 (Nov.) | 94.0 | 90.2 | 89.2*/— | 93.5 | 74.3* | 91.0* |
| IMOAnswerBench | 85.4 | 78.3 | 78.6/81.8 | 82.0 | 60.4* | 80.9* |
| Coding | ||||||
| LiveCodeBench-V6 | 86.4 | 83.3 | 83.1/85.0 | 84.9 | — | 80.6 (81.6*) |
| SWE-bench Verified | 74.4 | 73.1 | 71.3/76.8 | 73.8 | 74.0 | 73.4 |
| Terminal-Bench 2.0 | 51.0 | 46.4 | 35.7*/50.8 | 41.0 | 47.9 | 38.5 |
temperature=0.6, top_p=0.95temperature=1.0, top_p=0.95.| Component | Specification |
|---|---|
| Backbone | 45-layer Transformer (4,096 hidden dim) |
| Context Window | 256K |
| Vocabulary | 128,896 tokens |
| Total Parameters | 196.81B (196B Backbone + 0.81B Head) |
| Active Parameters | ~11B (per token generation) |
OpenRouter now offers free trial for Step 3.5 Flash.
| Provider | Website | Base URL |
|---|---|---|
| OpenRouter | https://openrouter.ai | https://openrouter.ai/api/v1 |
| StepFun | https://platform.stepfun.ai | https://api.stepfun.ai/v1 |
pip install --upgrade "openai>=1.0"1from openai import OpenAI
2
3client = OpenAI(
4 api_key="YOUR_API_KEY",
5 base_url="https://api.stepfun.ai/v1", # or "https://openrouter.ai/api/v1"
6 # Optional: OpenRouter headers for app rankings
7 default_headers={
8 "HTTP-Referer": "<YOUR_SITE_URL>",
9 "X-Title": "<YOUR_SITE_NAME>",
10 }
11)
12
13completion = client.chat.completions.create(
14 model="step-3.5-flash", # Use "stepfun/step-3.5-flash" for OpenRouter
15 messages=[
16 {
17 "role": "system",
18 "content": "You are an AI chat assistant provided by StepFun. You are good at Chinese, English, and many other languages.",
19 },
20 {
21 "role": "user",
22 "content": "Introduce StepFun's artificial intelligence capabilities."
23 },
24 ],
25)
26
27print(completion.choices[0].message.content)1# via Docker
2docker pull vllm/vllm-openai:nightly
3
4# or via pip (nightly wheels)
5pip install -U vllm --pre \
6 --index-url https://pypi.org/simple \
7 --extra-index-url https://wheels.vllm.ai/nightly1vllm serve <MODEL_PATH_OR_HF_ID> \
2 --served-model-name step3p5-flash \
3 --tensor-parallel-size 8 \
4 --enable-expert-parallel \
5 --disable-cascade-attn \
6 --reasoning-parser step3p5 \
7 --enable-auto-tool-choice \
8 --tool-call-parser step3p5 \
9 --hf-overrides '{"num_nextn_predict_layers": 1}' \
10 --speculative_config '{"method": "step3p5_mtp", "num_speculative_tokens": 1}' \
11 --trust-remote-code \
12 --quantization fp81vllm serve <MODEL_PATH_OR_HF_ID> \
2 --served-model-name step3p5-flash \
3 --tensor-parallel-size 8 \
4 --enable-expert-parallel \
5 --disable-cascade-attn \
6 --reasoning-parser step3p5 \
7 --enable-auto-tool-choice \
8 --tool-call-parser step3p5 \
9 --hf-overrides '{"num_nextn_predict_layers": 1}' \
10 --speculative_config '{"method": "step3p5_mtp", "num_speculative_tokens": 1}' \
11 --trust-remote-code 1# via Docker
2docker pull lmsysorg/sglang:dev-pr-18084
3# or from source (pip)
4pip install "sglang[all] @ git+https://github.com/sgl-project/sglang.git"1sglang serve --model-path <MODEL_PATH_OR_HF_ID> \
2 --served-model-name step3p5-flash \
3 --tp-size 8 \
4 --tool-call-parser step3p5 \
5 --reasoning-parser step3p5 \
6 --speculative-algorithm EAGLE \
7 --speculative-num-steps 3 \
8 --speculative-eagle-topk 1 \
9 --speculative-num-draft-tokens 4 \
10 --enable-multi-layer-eagle \
11 --host 0.0.0.0 \
12 --port 80001sglang serve --model-path <MODEL_PATH_OR_HF_ID> \
2 --served-model-name step3p5-flash \
3 --tp-size 8 \
4 --ep-size 8 \
5 --tool-call-parser step3p5 \
6 --reasoning-parser step3p5 \
7 --speculative-algorithm EAGLE \
8 --speculative-num-steps 3 \
9 --speculative-eagle-topk 1 \
10 --speculative-num-draft-tokens 4 \
11 --enable-multi-layer-eagle \
12 --host 0.0.0.0 \
13 --port 80001from transformers import AutoModelForCausalLM, AutoTokenizer
2
3MODEL_PATH = "<MODEL_PATH_OR_HF_ID>"
4
5# 1. Setup
6tokenizer = AutoTokenizer.from_pretrained(MODEL_PATH)
7model = AutoModelForCausalLM.from_pretrained(
8 MODEL_PATH,
9 trust_remote_code=True,
10 torch_dtype="auto",
11 device_map="auto",
12)
13
14# 2. Prepare Input
15messages = [{"role": "user", "content": "Explain the significance of the number 42."}]
16inputs = tokenizer.apply_chat_template(
17 messages,
18 tokenize=True,
19 add_generation_prompt=True,
20 return_dict=True,
21 return_tensors="pt",
22).to(model.device)
23
24# 3. Generate
25generated_ids = model.generate(**inputs, max_new_tokens=128, do_sample=False)
26output_text = tokenizer.decode(generated_ids[0][inputs.input_ids.shape[1]:], skip_special_tokens=True)
27
28print(output_text)the folderStep-3.5-Flash/tree/main/llama.cppis obsolete
1git clone https://github.com/ggml-org/llama.cpp
2cd llama.cpp1cmake -S . -B build-macos \
2 -DCMAKE_BUILD_TYPE=Release \
3 -DGGML_METAL=ON \
4 -DGGML_ACCELERATE=ON \
5 -DLLAMA_BUILD_EXAMPLES=ON \
6 -DLLAMA_BUILD_COMMON=ON \
7 -DGGML_LTO=ON
8cmake --build build-macos -j81cmake -S . -B build-cuda \
2 -DCMAKE_BUILD_TYPE=Release \
3 -DGGML_CUDA=ON \
4 -DGGML_CUDA_GRAPHS=ON \
5 -DLLAMA_CURL=OFF \
6 -DLLAMA_BUILD_EXAMPLES=ON \
7 -DLLAMA_BUILD_COMMON=ON
8cmake --build build-cuda -j81cmake -S . -B build-vulkan \
2 -DCMAKE_BUILD_TYPE=Release \
3 -DLLAMA_CURL=OFF \
4 -DGGML_OPENMP=ON \
5 -DGGML_VULKAN=ON
6cmake --build build-vulkan -j8./llama-cli -m step3.5_flash_Q4_K_S.gguf -c 16384 -b 2048 -ub 2048 -fa on --temp 1.0 -p "What's your name?"./llama-batched-bench -m step3.5_flash_Q4_K_S.gguf -c 32768 -b 2048 -ub 2048 -npp 0,2048,8192,16384,32768 -ntg 128 -npl 11# Install nvm on Mac/Linux via curl:
2# Step 1
3curl -o- https://raw.githubusercontent.com/nvm-sh/nvm/v0.39.0/install.sh | bash
4
5# Copy the full command
6export NVM_DIR="$HOME/.nvm"
7[ -s "$NVM_DIR/nvm.sh" ] && \. "$NVM_DIR/nvm.sh" # This loads nvm
8[ -s "$NVM_DIR/bash_completion" ] && \. "$NVM_DIR/bash_completion"
9
10# Users in China can set up npm mirror
11config set registry https://registry.npmmirror.com
12
13# Step 2
14nvm install v22
15
16# Make sure Node.js is installed
17node --version
18
19npm --versionnvm-setup.exe) from https://github.com/coreybutler/nvm-windows/releases. Follow the instructions to install nvm. Run nvm commands to make sure it is installed.1# install claude code via npm
2npm install -g @anthropic-ai/claude-code
3
4# test if the installation is successful
5claude --version If you intend to use the OpenRouter API, refer to the OpenRouter integration guide.
~/.claude/settings.json.You only need to modify the fields shown below. Leave the rest of the file unchanged.
1{
2"env": {
3 "ANTHROPIC_API_KEY": "API_KEY_from_StepFun",
4 "ANTHROPIC_BASE_URL": "https://api.stepfun.ai/"
5},
6"model": "step-3.5-flash"
7}/status to confirm the model and base URL.1❯ /status
2─────────────────────────────────────────────────────────────────────────────────
3Settings: Status Config Usage (←/→ or tab to cycle)
4
5Version: 2.1.1
6Session name: /rename to add a name
7Session ID: 676dae61-259d-4eef-8c2f-0f1641600553
8cwd: /Users/step-test/
9Auth token: none
10API key: ANTHROPIC_API_KEY
11Anthropic base URL: https://api.stepfun.ai/
12
13Model: step-3.5-flash
14Setting sources: User settingsNote: OpenAI API style here refers to thechat/completions/format.
We recommend usingclaude-code-router. For details, see https://github.com/musistudio/claude-code-router.
claude-code-router :1# install ccr via npm
2npm install -g @musistudio/claude-code-router
3
4# validate it is installed
5ccr -v~/.claude-code-router/config.json.1{
2"PORT": 3456,
3"Providers": [
4 {
5 "name": "stepfun-api",
6 "api_base_url": "https://api.stepfun.com/v1/chat/completions",
7 "api_key": "StepFun_API_KEY",
8 "models": ["step-3.5-flash"],
9 "transformer":{
10 "step-3.5-flash": { "use": ["OpenAI"]}
11 }
12 }
13],
14"Router": {
15 "default": "stepfun-api,step-3.5-flash",
16 "background": "stepfun-api,step-3.5-flash",
17 "think": "stepfun-api,step-3.5-flash",
18 "longContext": "stepfun-api,step-3.5-flash",
19 "webSearch": "stepfun-api,step-3.5-flash"
20}
21}1# Start Claude
2ccr code
3
4# restart ccr if configs are changed
5ccr restart 1# Install codex via npm
2npm install -g @openai/codex
3
4# Test if it is installed
5codex --version~/.codex/config.toml, keeping the rest of the settings as they are.1model="step-3.5-flash"
2model_provider = "stepfun-chat"
3preferred_auth_method = "apikey"
4
5# configure the provider
6[model_providers.stepfun-chat]
7name = "OpenAI using response"
8base_url = "https://api.stepfun.com/v1"
9env_key = "OPENAI_API_KEY"
10wire_api = "chat"
11query_params = {}wire_api only supports chat . If you use the responses mode, you'll need to change to chat. Please also switch model_provider to the newly configured stepfun-chat./status to check the configuration.1/status
2📂 Workspace
3 • Path: /Users/step-test/
4 • Approval Mode: on-request
5 • Sandbox: workspace-write
6 • AGENTS files: (none)
7
8🧠 Model
9 • Name: step-3.5-flash
10 • Provider: Stepfun-chat
11
12💻 Client
13 • CLI Version: 0.40.0MODEL_NAME to Step-3.5-Flash. https://github.com/stepfun-ai/StepDeepResearch?tab=readme-ov-file#1-environment-setup1@misc{huang2026step35flashopen,
2 title={Step 3.5 Flash: Open Frontier-Level Intelligence with 11B Active Parameters},
3 author={Ailin Huang and Ang Li and Aobo Kong and Bin Wang and Binxing Jiao and Bo Dong and Bojun Wang and Boyu Chen and Brian Li and Buyun Ma and Chang Su and Changxin Miao and Changyi Wan and Chao Lou and Chen Hu and Chen Xu and Chenfeng Yu and Chengting Feng and Chengyuan Yao and Chunrui Han and Dan Ma and Dapeng Shi and Daxin Jiang and Dehua Ma and Deshan Sun and Di Qi and Enle Liu and Fajie Zhang and Fanqi Wan and Guanzhe Huang and Gulin Yan and Guoliang Cao and Guopeng Li and Han Cheng and Hangyu Guo and Hanshan Zhang and Hao Nie and Haonan Jia and Haoran Lv and Hebin Zhou and Hekun Lv and Heng Wang and Heung-Yeung Shum and Hongbo Huang and Hongbo Peng and Hongyu Zhou and Hongyuan Wang and Houyong Chen and Huangxi Zhu and Huimin Wu and Huiyong Guo and Jia Wang and Jian Zhou and Jianjian Sun and Jiaoren Wu and Jiaran Zhang and Jiashu Lv and Jiashuo Liu and Jiayi Fu and Jiayu Liu and Jie Cheng and Jie Luo and Jie Yang and Jie Zhou and Jieyi Hou and Jing Bai and Jingcheng Hu and Jingjing Xie and Jingwei Wu and Jingyang Zhang and Jishi Zhou and Junfeng Liu and Junzhe Lin and Ka Man Lo and Kai Liang and Kaibo Liu and Kaijun Tan and Kaiwen Yan and Kaixiang Li and Kang An and Kangheng Lin and Lei Yang and Liang Lv and Liang Zhao and Liangyu Chen and Lieyu Shi and Liguo Tan and Lin Lin and Lina Chen and Luck Ma and Mengqiang Ren and Michael Li and Ming Li and Mingliang Li and Mingming Zhang and Mingrui Chen and Mitt Huang and Na Wang and Peng Liu and Qi Han and Qian Zhao and Qinglin He and Qinxin Du and Qiuping Wu and Quan Sun and Rongqiu Yang and Ruihang Miao and Ruixin Han and Ruosi Wan and Ruyan Guo and Shan Wang and Shaoliang Pang and Shaowen Yang and Shengjie Fan and Shijie Shang and Shiliang Yang and Shiwei Li and Shuangshuang Tian and Siqi Liu and Siye Wu and Siyu Chen and Song Yuan and Tiancheng Cao and Tianchi Yue and Tianhao Cheng and Tianning Li and Tingdan Luo and Wang You and Wei Ji and Wei Yuan and Wei Zhang and Weibo Wu and Weihao Xie and Wen Sun and Wenjin Deng and Wenzhen Zheng and Wuxun Xie and Xiangfeng Wang and Xiangwen Kong and Xiangyu Liu and Xiangyu Zhang and Xiaobo Yang and Xiaojia Liu and Xiaolan Yuan and Xiaoran Jiao and Xiaoxiao Ren and Xiaoyun Zhang and Xin Li and Xin Liu and Xin Wu and Xing Chen and Xingping Yang and Xinran Wang and Xu Zhao and Xuan He and Xuanti Feng and Xuedan Cai and Xuqiang Zhou and Yanbo Yu and Yang Li and Yang Xu and Yanlin Lai and Yanming Xu and Yaoyu Wang and Yeqing Shen and Yibo Zhu and Yichen Lv and Yicheng Cao and Yifeng Gong and Yijing Yang and Yikun Yang and Yin Zhao and Yingxiu Zhao and Yinmin Zhang and Yitong Zhang and Yixuan Zhang and Yiyang Chen and Yongchi Zhao and Yongshen Long and Yongyao Wang and Yousong Guan and Yu Zhou and Yuang Peng and Yuanhao Ding and Yuantao Fan and Yuanzhen Yang and Yuchu Luo and Yudi Zhao and Yue Peng and Yueqiang Lin and Yufan Lu and Yuling Zhao and Yunzhou Ju and Yurong Zhang and Yusheng Li and Yuxiang Yang and Yuyang Chen and Yuzhu Cai and Zejia Weng and Zetao Hong and Zexi Li and Zhe Xie and Zheng Ge and Zheng Gong and Zheng Zeng and Zhenyi Lu and Zhewei Huang and Zhichao Chang and Zhiguo Huang and Zhiheng Hu and Zidong Yang and Zili Wang and Ziqi Ren and Zixin Zhang and Zixuan Wang},
4 year={2026},
5 eprint={2602.10604},
6 archivePrefix={arXiv},
7 primaryClass={cs.CL},
8 url={https://arxiv.org/abs/2602.10604},
9}