Views
No views yet
1try (var gen = OnnxTextGenerator.smolLM2_1_7B().build()) {
2 GenerationResult result = gen.generate("What is Java?");
3 System.out.println(result.text());
4}| Property | Value |
|---|---|
| Architecture | LlamaForCausalLM (1.7B parameters, 24 layers, 2048 hidden, 32 heads, 32 KV heads) |
| Task | Text generation (instruction-tuned) |
| Precision | FP16 |
| Context length | 8192 tokens |
| Vocabulary | 49,152 tokens (BPE) |
| Chat template | ChatML (`< |
| Original framework | PyTorch (transformers) |
| Export method | Hugging Face Optimum (with KV cache, FP16) |