This model was compiled using MLC-LLM with q4f32_1 quantization from google/gemma-2-2b-it. The conversion was done using the MLC-Weight-Conversion space.

To run this model, please first install MLC-LLM.

To chat with the model on your terminal:

For more information on how to use MLC-LLM, please visit the MLC-LLM documentation.