gpt-oss-20b ONNX model (deqauntized to BF16)

Model Overview

• Source Model: openai/gpt-oss-20b from 🤗
• Exported Format: ONNX
• Precision: BF16 (dequantized from MXFP4 for GPU compatibility)
• Layers: 24 decoder layers, embedding layer, final normalization, and language modeling (LM) head

Generation Details

• Loading the original gpt-oss-20b checkpoint from 🤗
• Reading and converting all model layers (embedding, decoder, final norm, LM head)
• Saving the ONNX model and associated external data file
• Exporting tokenizer and configuration files
• Model layers and weights were successfully read and converted
• MXFP4 quantized weights were dequantized to BF16
• All necessary files for GenAI runtime and Hugging Face integration were generated

Usage

1. Download the model files and tokenizer assets from this repository.
2. Load the ONNX model using onnxruntime or compatible inference engines.

Acknowledgements

• Original model: openai/gpt-oss-20b from 🤗
• ONNX export: onnxruntime-genai by Microsoft