Production configuration profiles for the config-driven serve harness.
Config
Model
Notes
qwen2.5-7b
Qwen 2.5 7B Instruct
Baseline 7B
qwen3.6-27b
Qwen 3.6 27B
Mid-size
qwen3.6-35b-a3b
Qwen 3.6 35B A3B
MoE baseline
qwen3.6-35b-a3b-baseline
Qwen 3.6 35B A3B
Baseline sweep
qwen3.6-35b-a3b-mtp0
Qwen 3.6 35B A3B
MTP depth 0
qwen3.6-35b-a3b-mtp3
Qwen 3.6 35B A3B
MTP depth 3
qwen3.6-35b-a3b-throughput
Qwen 3.6 35B… See the full description on the dataset page:
https://huggingface.co/datasets/EXDai/vllm-configs.