Views
No views yet
.pte model converted from meta-llama/Llama-3.2-1B-Instruct for on-device inference with ToMogo.| Property | Value |
|---|---|
| Source | meta-llama/Llama-3.2-1B-Instruct |
| Format | executorch |
| Quantization | int4 weight-only |
| Backend | xnnpack |
| Fusion | disabled |
| Total Size | 2199.6 MB |
| File | Size |
|---|---|
README.md | 0.0 MB |
chat_template.jinja | 0.0 MB |
export_config.json | 0.0 MB |
model.pte | 2183.1 MB |
tokenizer.json | 16.4 MB |
tokenizer_config.json | 0.0 MB |
1val engine = ExecuTorchEngine(modelDir = "/path/to/Llama-3.2-1B-Instruct-ET")
2engine.prefill(prompt) { token -> print(token) }