Views
No views yet
yunmorning/broken-model for use with chat-completions style inference servers.tokenizer_config.json did not define chat_template. As a result, chat-serving stacks that rely on the tokenizer to serialize OpenAI-style chat messages cannot construct a model prompt. In Transformers, this reproduces as:ValueError: Cannot use chat template functions because tokenizer.chat_template is not set and no template argument was passed./chat/completions API server from formatting requests such as [{"role": "user", "content": "Hello"}] into the Qwen chat format.tokenizer_config.json.chat_template using the official Qwen/Qwen3-8B chat template.base_model metadata from meta-llama/Meta-Llama-3.1-8B to Qwen/Qwen3-8B to match the actual config.json architecture and tensor structure.config.json, generation_config.json, tokenizer vocabulary, or special token IDs.config.json and generation_config.json already match the official Qwen3-8B configuration. The model weights also use Qwen3-style tensor names such as self_attn.q_norm and self_attn.k_norm. The missing chat template was the only runtime configuration issue required to make chat message formatting work.1<|im_start|>user
2Hello<|im_end|>
3<|im_start|>assistant