Views
No views yet
<think> reasoning. It is competitive with models 4x larger on tool use, instruction following, and multi-step agentic tasks.| Refusals (harmful eval) | 6 / 100 (baseline ~90 / 100) |
| KL divergence | 0.0335 (same-prefix, far below 0.5 prune threshold) |
| Length deviation | 0.079 σ |
| Generation health | PASSED |
| Selected trial | abliterix Trial 65 |
| Thinking | Preserved — always-thinks (<think> in chat template) |
W += (B @ A) * (alpha / r) (this trial alpha = r = 1); steering applied to attn.o_proj / conv.out_proj / mlp.down_proj across 30 layers.| Architecture | LFM2 hybrid (transformers lfm2, Lfm2ForCausalLM) |
| Parameters | 2.69B total |
| Layers | 30 (22 double-gated short-conv + 8 GQA) |
| Context | 131,072 tokens |
| Vocab | 128,000 |
| Hidden / FFN | 2048 / 10752 |
| Reasoning | Always-thinks (<think> in chat template) |
| Languages | EN, ZH, AR, FR, DE, HI, ID, IT, JA, KO, PL, PT, RU, ES, TH, VI |
| This repo | BF16 safetensors (single shard, ~5.4 GB) + tokenizer + chat template |
model.safetensors | Merged BF16 weights (5.39 GB) |
config.json / generation_config.json | lfm2 config + official sampling defaults |
tokenizer.json / tokenizer_config.json | 128K vocab tokenizer |
chat_template.jinja | ChatML-like template with <think> + tool-use tokens |
lfm2 architecture is natively supported by transformers >= 5.0.0 — no trust_remote_code needed.from transformers import AutoModelForCausalLM, AutoTokenizer
[object Object]
[object Object]output = model.generate(
input_ids,
do_sample=True,
temperature=0.1,
top_k=50,
repetition_penalty=1.1,
max_new_tokens=512,
)
print(tokenizer.decode(output[0][input_ids.shape[1]:], skip_special_tokens=True))temperature 0.1, top_k 50, repetition_penalty 1.1 (they are baked into generation_config.json). If you want more creative answers, raise temperature toward 0.6–0.8; note the model always thinks before answering, so allow enough max_new_tokens for the <think> block.kl_divergence < 0.5.W += B@A, alpha = r = 1).lfm2), then quantized with imatrix calibration (401 chunks from the APEX calibration set) into Q4_K_M / Q6_K / Q8_0 / IQ4_XS / IQ3_XS — see the GGUF repo.