
palmer, a new family of small language models trained with better foundational models, better data but same tasks: Text rewriting, paraphrasing, tone transfer, grammar-style editing, and instruction-following text transformations. With only 90m parameters, this model is perfect for experiments on small SBCs and low-power devices.Our custom evaluation consists of 100 text-editing tasks where the model has to modify a diversity of texts in different ways. All models were evaluated usingq8_0gguf quantization.
| Model | Avg | Emb | String | Token | Rule | Exact | Strict | Flagged | Params |
|---|---|---|---|---|---|---|---|---|---|
🥇 nano | 84.70 | 95.81 | 81.12 | 78.22 | 87.57 | 39/100 | 68/100 | 19/100 | 90m |
lfm2 | 72.04 | 93.19 | 62.00 | 56.22 | 75.35 | 21/100 | 40/100 | 35/100 | 700m |
granite4 | 71.96 | 92.54 | 65.01 | 54.98 | 76.41 | 17/100 | 34/100 | 33/100 | 350m |
qwen3 | 51.81 | 87.76 | 45.26 | 33.65 | 50.80 | 6/100 | 22/100 | 60/100 | 600m |
Note: the model has not been tested as a chat assistant and it might not work as intended, use with caution.