You can deploy this model and start earning money today!

kazssym/
granite-3b-code-instruct-128k-onnx

Name: granite-3b-code-instruct-128k-onnx
Availability: InStock

Views

No views yet

This model was exported from ibm-granite/granite-3b-code-instruct-128k using Optimum with the basic optimization by ONNX Runtime.

The repository owner maintains this model for use with Transformers.js and DirectML. The required external data format support was implemented in 3.4.0.

Trial

This model is currently being tested as follows:

import  { pipeline } from "@huggingface/transformers"

const generator = await pipeline(
  "text-generation",
  "kazssym/granite-3b-code-instruct-128k-onnx",
  {
    device: "dml",
    use_external_data_format: true,
    session_options: {
    },
  },
)