SmolLM2-135M is an ultra-compact model that excels at on-device tasks like text rewriting, summarization, and simple NPC dialogue while maintaining an exceptionally small memory footprint.

Available Versions

File Name	Format	Precision	Size	Best For
`model.onnx`	ONNX	FP32	~530MB	High-fidelity source / Desktop
`model_FP16.sentis`	Sentis	FP16	~320MB	Balanced Performance / Mobile
`model_Uint8.sentis`	Sentis	Uint8	~160MB	Maximum Performance / WebGL / Low-end Mobile

How to use in Unity

Install Sentis: Use the Unity Package Manager to install com.unity.sentis (2.1.0+ recommended).
Download Model: Choose the .sentis file based on your target platform's memory constraints.
Import: Drag the .sentis file and the tokenizer.json into your Unity project.

Basic C# Loading Snippet

csharp

using Unity.Sentis;
using UnityEngine;

public class TinyLLM : MonoBehaviour {
    public ModelAsset modelAsset;
    private IWorker engine;

    void Start() {
        Model runtimeModel = ModelLoader.Load(modelAsset);
        // GPUCompute is recommended for mobile performance
        engine = WorkerFactory.CreateWorker(BackendType.GPUCompute, runtimeModel);
    }
}

dtaddis/SmolLM2-135M-Instruct-Unity

SmolLM2-135M-Instruct for Unity Sentis

Available Versions

How to use in Unity

Basic C# Loading Snippet

dtaddis/
SmolLM2-135M-Instruct-Unity