Granite-3.1-8B-Instruct is a 8B parameter long-context instruct model finetuned from Granite-3.1-8B-Base using a combination of open source instruction datasets with permissive license and internally collected synthetic datasets tailored for solving long context problems. This model is developed using a diverse set of techniques with a structured chat format, including supervised finetuning, model alignment using reinforcement learning, and model merging.
This is based on the implementation of IBM-Granite-v3.1-8B-Instruct found
here.
This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the
Qualcomm® AI Hub Models library to export with custom configurations. More details on model performance across various devices, can be found
here.
Qualcomm AI Hub Models uses
Qualcomm AI Hub Workbench to compile, profile, and evaluate this model.
Sign up to run these models on a hosted Qualcomm® device.
This model is available for purchase. Please
contact us to learn more about licensing options.
Due to licensing restrictions, we cannot distribute pre-exported model assets for this model.
Use the
Qualcomm® AI Hub Models Python library to compile and export the model with your own:
This model may not be used for or in connection with any of the following applications:
