You can deploy this model and start earning money today!

Yobitel/
deepseek-ai-deepseek-coder-v2-lite-instructllm-inference-chatbot-short019e3b6f22ca

Views

No views yet

deepseek-ai/DeepSeek-Coder-V2-Lite-Instruct on llm.inference.chatbot-short (NVIDIA H100 80GB HBM3)

Back to leaderboard

	Headline metrics

Metric Value Unit

TTFT P50 74.4268 ms

TTFT P99 521.1922 ms

TPOT P50 21.0371 ms

TPOT P99 23.458 ms

Total P50 Ms 2661.4077

Total P99 Ms 3136.5972

Req Per S Passing 1.0172

Req Per S All 1.1559

Compliance Rate 0.88

Ok Rate 1

Throughput Tok Per S 134.316

Power Avg W 808.3085