You can deploy this model and start earning money today!

amd/
gemma-2-2b-onnx-ryzenai-hybrid

Name: gemma-2-2b-onnx-ryzenai-hybrid
Availability: InStock

Views

No views yet

amd/gemma-2-2b

Introduction

This model was created using Quark Quantization, followed by OGA Model Builder, and finalized with post-processing for NPU deployment.
Quantization Strategy
- AWQ / Group 128 / Asymmetric / BFP16 activations / UINT4 weights
Quick Start

For quickstart, refer to Ryzen AI doucmentation

The MMLU scores are, astronomy: 55.26, philosophy: 56.91 and management: 69.9.