Inference benchmark datasets and results for the Odyn Network — a distributed, OpenAI-compatible AI inference platform built on vLLM, Ray Serve, and FastAPI.
Dataset Structure
Prompt Profiles (data/)
Four load profiles covering the full input/output token distribution space, sourced from real Odyn traffic and augmented with ShareGPT Vicuna Unfiltered: