Views
No views yet
<eos> (1), <end_of_turn> (106).litertlm file from this repoadb push *.litertlm /sdcard/Download/1val options = LlmInferenceOptions.builder()
2 .setModelPath("/path/to/rust_mentor_1b_mobile.litertlm")
3 .setMaxTokens(512)
4 .build()
5val llm = LlmInference.createFromOptions(context, options)
6val response = llm.generateResponse("Explain Rust ownership to a Go developer")| Parameter | Value |
|---|---|
| Base Model | google/gemma-3-1b-it |
| Method | QLoRA via Unsloth |
| LoRA Rank | 16 |
| Epochs | 3 |
| Effective Batch Size | 8 |
| Learning Rate | 2e-4 (cosine) |
| Parameter | Value |
|---|---|
| Converter | litert-torch (Gemma3 built-in) |
| Quantization | Dynamic INT8 |
| KV Cache | 2048 |
| Format | .litertlm |
| GPU Delegation | Full on Tensor G3 |