Token counts computed using the gpt-oss-120b tokenizer.
Input tokens: tokens in the prompt sent to the model.
Reasoning tokens: tokens used for chain-of-thought reasoning (included in the API's completion_tokens).
Output tokens: non-reasoning completion tokens (completion_tokens - reasoning_tokens), i.e. the actual document text.
Total: prompt_tokens + completion_tokens (reasoning is NOT double-counted).
Input tokens
11,634… See the full description on the dataset page:
https://huggingface.co/datasets/MichaelR207/rephraser_mid_check_0219.
