You can deploy this model and start earning money today!

Yobitel/
google-gemma-2-9b-itllm-inference-chatbot-short019e3b973b4f

Views

No views yet

google/gemma-2-9b-it on llm.inference.chatbot-short (NVIDIA H100 80GB HBM3)

Back to leaderboard

	Headline metrics

Metric Value Unit

TTFT P50 30.0542 ms

TTFT P99 183.9538 ms

TPOT P50 8.648 ms

TPOT P99 10.7976 ms

Total P50 Ms 1095.4794

Total P99 Ms 1422.5879

Req Per S Passing 3.3476

Req Per S All 3.3947

Compliance Rate 0.9861

Ok Rate 1

Throughput Tok Per S 385.0208

Power Avg W 901.0112

Power Peak W 937.794