Yobitel/

deepseek-ai-deepseek-coder-v2-lite-instruct__code-generation-mbpp-mini__019e3b6f7d82

Back to leaderboard

	Headline metrics




	

Metric Value Unit

N Samples 5

N Ok 5

Ok Rate 1

Pass At 1 1

Pass At 1 P05 1

Pass At 1 P50 1

Pass At 1 P95 1

Timeout Rate 0

TTFT P50 55.0369 ms

Total P50 Ms 1212.8

Tokens Out Total 807

Model: deepseek-ai/DeepSeek-Coder-V2-Lite-Instruct @ unknown00 Engine: vllm… See the full description on the dataset page: https://huggingface.co/datasets/Yobitel/deepseek-ai-deepseek-coder-v2-lite-instruct__code-generation-mbpp-mini__019e3b6f7d82.