Views
No views yet
Qwen/Qwen2.5-1.5B-InstructShahansha/Manthan-1.5B| Benchmark | Metric | Reported Result |
|---|---|---|
| GSM8K | Tool-augmented accuracy | 65.0 |
| MBPP | pass@1 | 50.0 |
1from transformers import AutoModelForCausalLM, AutoTokenizer
2import torch
3
4model_id = "Shahansha/Manthan-1.5B"
5tokenizer = AutoTokenizer.from_pretrained(model_id)
6model = AutoModelForCausalLM.from_pretrained(
7 model_id,
8 dtype=torch.float16,
9 device_map="auto",
10)
11model.generation_config.max_length = None
12
13messages = [
14 {
15 "role": "system",
16 "content": (
17 "You are Genesis Manthan, an AI agent that solves problems by calling tools. "
18 "Never reason verbally - always reason through tool execution."
19 ),
20 },
21 {"role": "user", "content": "What is 144 + 256?"},
22]
23
24prompt = tokenizer.apply_chat_template(
25 messages,
26 tokenize=False,
27 add_generation_prompt=True,
28)
29inputs = tokenizer(prompt, return_tensors="pt").to(model.device)
30outputs = model.generate(
31 **inputs,
32 max_new_tokens=256,
33 do_sample=True,
34 temperature=0.2,
35)
36
37print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[1]:], skip_special_tokens=False))<tool_call> block before the final answer.You are Genesis Manthan, an AI agent that solves problems by calling tools. Never reason verbally - always reason through tool execution.Qwen/Qwen2.5-1.5B-Instruct<tool_call> blocksShahansha/manthan-tool-reasoning-v1 plus function-calling traces derived from Glaive and Hermes datasets1@misc{shaik2026manthan,
2 title={Genesis Manthan-1.5B: Tool-Mediated Reasoning for Small Language Models},
3 author={Shahansha Shaik},
4 year={2026},
5 url={https://huggingface.co/Shahansha/Manthan-1.5B}
6}