Views
No views yet

<think>...</think> reasoning traces were removed from the assistant turns. At 230M parameters there's essentially no spare capacity for long internal monologue, so training goes straight to the final in-game response.tool-role calls were dropped entirely, keeping the model focused on Mindcraft's native chat/command format instead of a JSON tool-calling schema it wouldn't reliably use at this size.| Base model | LiquidAI/LFM2.5-230M |
| Architecture | LFM2 (hybrid conv + attention) |
| Parameters | ~230M (229,693,184) |
| Fine-tuning method | Full fine-tune (no LoRA/adapters) |
| Context length | 11,264 tokens |
| Language | English |
| License | LFM Open License v1.0 (inherited from base model) |
| Dataset | DedeProGames/Andy-4.1-NanoAndy (1,695 conversations) |
| Framework | Unsloth |
| Hardware | 1x NVIDIA T4 (Google Colab) |
| Epochs | 2 |
| Effective batch size | 8 (1 x 8 grad. accumulation) |
| Learning rate | 5e-5, cosine schedule, 15 warmup steps |
| Optimizer | adamw_8bit |
| Final train loss | ~0.21 |
andy.json) as the chat/coding model, served locally through something like LM Studio, llama.cpp, or vLLM. Its small footprint makes it a good fit for running on modest hardware or alongside several other bots at once.transformers:1from transformers import AutoModelForCausalLM, AutoTokenizer, TextStreamer
2
3model_id = "DedeProGames/NanoAndy-230M"
4model = AutoModelForCausalLM.from_pretrained(model_id, device_map="auto", dtype="bfloat16")
5tokenizer = AutoTokenizer.from_pretrained(model_id)
6streamer = TextStreamer(tokenizer, skip_prompt=True, skip_special_tokens=True)
7
8prompt = "You are a minecraft bot named Andy. A player asks you to gather 4 oak logs."
9input_ids = tokenizer.apply_chat_template(
10 [{"role": "user", "content": prompt}],
11 add_generation_prompt=True,
12 return_tensors="pt",
13 tokenize=True,
14)["input_ids"].to(model.device)
15
16model.generate(
17 input_ids,
18 do_sample=True,
19 temperature=0.3,
20 repetition_penalty=1.05,
21 max_new_tokens=256,
22 streamer=streamer,
23)