Views
No views yet
<think>...</think> scratchpad layout. It dynamically breaks down complex mathematical, logical, and structural prompts before committing to a final conclusion.
| Benchmark | Paradigm | Atomight-2-1.5B-Thinking | Qwen-2-1.5B-Instruct | Phi-3-mini (3.8B) | Llama-3.2-3B-Instruct |
|---|---|---|---|---|---|
| GSM8k | Math Logical Chains | 80.1% | 71.0% | 82.5% | 73.1% |
| ARC-C | Core Reasoning | 88.5% | 82.3% | 84.9% | 83.3% |
| MMLU | General Knowledge | 63.2% | 56.7% | 68.8% | 61.1% |
⚠️ Evaluation Insight: While Atomight-2 exhibits class-leading spikes on core textual logic and mathematical proofs, it experiences a classic reasoning tradeoff. On abstract matrix-grid visual transformation evaluations (like ARC-AGI 2), it drops to a baseline floor of 0.00%. This cognitive bottleneck highlights an instruction deficit in translating spatial imagery into basic structural text tokens—a major priority slated for the next architecture generation.
1import torch
2from transformers import AutoTokenizer, AutoModelForCausalLM
3
4MODEL_ID = "NovatasticRoScript/Atomight-2-1.5B-Thinking"
5
6tokenizer = AutoTokenizer.from_pretrained(MODEL_ID, trust_remote_code=True)
7model = AutoModelForCausalLM.from_pretrained(
8 MODEL_ID,
9 torch_dtype=torch.float16,
10 device_map="auto",
11 trust_remote_code=True
12)
13
14# Structure conversational dialog into ChatML framework
15messages = [
16 {"role": "user", "content": "A retailer buys shirts for $15 and sells them for $25. What is the total profit on 12 shirts?"}
17]
18
19templated_input = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
20inputs = tokenizer(templated_input, return_tensors="pt").to("cuda")
21
22print("🧠 Generating Reasoning Sequence:")
23outputs = model.generate(
24 **inputs,
25 max_new_tokens=768, # Plentiful headroom required for deep-thinking scratchpads
26 temperature=0.1,
27 do_sample=False,
28 pad_token_id=tokenizer.eos_token_id
29)
30
31print(tokenizer.decode(outputs[0], skip_special_tokens=False))