Yobitel/

mistralai-mistral-7b-instruct-v0-3__code-generation-humaneval-mini__019e3b4630cb

Back to leaderboard

	Headline metrics




	

Metric Value Unit

N Samples 5

N Ok 5

Ok Rate 1

Pass At 1 0.8

Pass At 1 P05 0.2

Pass At 1 P50 1

Pass At 1 P95 1

Timeout Rate 0

TTFT P50 14.9549 ms

Total P50 Ms 1243.2378

Tokens Out Total 824

Model: mistralai/Mistral-7B-Instruct-v0.3 @ unknown00 Engine: vllm vunknown… See the full description on the dataset page: https://huggingface.co/datasets/Yobitel/mistralai-mistral-7b-instruct-v0-3__code-generation-humaneval-mini__019e3b4630cb.