This is a minimal model built for unit tests in the TRL library.

Identical to trl-internal-testing/tiny-Qwen3MoeForCausalLM, except that it ships a response_template in tokenizer_config.json and its chat template carries a marker comment so it is not recognized by add_response_schema. Together these exercise the path where a model supplies its own response template.