ibm-granite/granite-3.3-2b-instruct (Optimized with Olive)
This is a
Granite-3.3-2B-Instruct model optimized using Microsoft Olive for ONNX Runtime GenAI.
Usage
1from onnxruntime_genai import GenAI
2
3model = GenAI("path/to/model")
4output = model.generate("Hello")
5print(output)
Granite-3.3-8B-Instruct
Model Summary:
Granite-3.3-8B-Instruct is a 8-billion parameter 128K context length language model fine-tuned for improved reasoning and instruction-following capabilities. Built on top of Granite-3.3-8B-Base, the model delivers significant gains on benchmarks for measuring generic performance including AlpacaEval-2.0 and Arena-Hard, and improvements in mathematics, coding, and instruction following. It supports structured reasoning through <think></think> and <response></response> tags, providing clear separation between internal thoughts and final outputs. The model has been trained on a carefully balanced combination of permissively licensed data and curated synthetic tasks.
- Developers: Granite Team, IBM
- Website: Granite Docs
- Release Date: April 16th, 2025
- License: Apache 2.0
Supported Languages:
English, German, Spanish, French, Japanese, Portuguese, Arabic, Czech, Italian, Korean, Dutch, and Chinese. However, users may finetune this Granite model for languages beyond these 12 languages.
Intended Use:
This model is designed to handle general instruction-following tasks and can be integrated into AI assistants across various domains, including business applications.
