Views
No views yet
| Benchmark | S1-Base-1.5-8B-128K | S1-Base-8B | Qwen3-8B | Intern-S1-mini | GLM-Z1-9B-0414 |
|---|---|---|---|---|---|
| CLongEval | 36.18 | 27.51 | 33.62 | 32.82 | 25.71 |
| InfiniteBench | 35.57 | 27.62 | 34.41 | 30.42 | 29.58 |
| IFEval | 87.06 | 70.42 | 85.00 | 83.00 | 78.93 |
| GPQA | 70.33 | 63.01 | 60.86 | 65.97 | 55.81 |
| ChemBench | 61.59 | 62.74 | 57.79 | 57.54 | 55.85 |
| LLM-MSE | 83.63 | 88.50 | 83.51 | 78.65 | 80.97 |
| LAB bench | 37.54 | 37.63 | 26.52 | 29.11 | 29.89 |
| AIME2024 | 77.92 | 75.42 | 74.60 | 85.00 | 79.37 |
| LiveMathBench | 86.72 | 82.81 | 77.00 | 86.72 | 82.82 |
1pip install vllm
2vllm serve <your_s1_model_path> --served-model-name s1-base-1.5-8b-128k1from openai import OpenAI
2
3client = OpenAI(base_url="http://localhost:8000/v1", api_key="")
4resp = client.chat.completions.create(
5 model="s1-base-1.5-8b-128k",
6 messages=[{"role": "user", "content": "hi"}]
7)
8print(resp.choices[0].message.content)curl -X POST http://localhost:8000/v1/chat/completions -d '{"model": "s1-base-1.5-8b-128k", "messages":[{"role":"user", "content": "hi"}], "skip_special_tokens": false}' -H "Content-Type: application/json"