Views
No views yet
<think> tags before taking any action, then calls the appropriate tool to complete the task.bash, read_file, write_file, edit_file, web_search and more| Base model | Qwen/Qwen3-8B |
| Dataset | Glint-Research/Fable-5-traces |
| Dataset size | 4,665 rows |
| Method | QLoRA (LoRA fine-tuning on 4-bit quantized model) |
| LoRA rank | 16 |
| LoRA alpha | 32 |
| Target modules | q_proj, k_proj, v_proj, o_proj, gate_proj, up_proj, down_proj |
| Training steps | 580 |
| Batch size | 2 × 8 grad accum = 16 effective |
| Learning rate | 2e-4 |
| Sequence length | 8192 |
| GPU | NVIDIA RTX 4000 Ada (20GB) |
| Framework | Unsloth + TRL |
| Final loss | ~0.27 |
<think> block)bash, read_file, write_file, etc.)| Tool | Count |
|---|---|
| bash | 1,544 |
| edit_file | 960 |
| text_response | 866 |
| read_file | 443 |
| write_file | 311 |
| web_search | 72 |
| + others | ~200 |
1from transformers import AutoModelForCausalLM, AutoTokenizer
2import torch
3
4model = AutoModelForCausalLM.from_pretrained(
5 "DhruvalLabs/qwen3-8b-claude-agentic-fable5",
6 torch_dtype=torch.bfloat16,
7 device_map="auto",
8)
9tokenizer = AutoTokenizer.from_pretrained("DhruvalLabs/qwen3-8b-claude-agentic-fable5")
10
11messages = [
12 {
13 "role": "system",
14 "content": (
15 "You are an expert agentic coding assistant. "
16 "Before every action, reason carefully inside <think>...</think> tags. "
17 "Then call the appropriate tool to complete the task step by step."
18 )
19 },
20 {
21 "role": "user",
22 "content": "/think\nRead the file main.py and summarize what it does."
23 }
24]
25
26inputs = tokenizer.apply_chat_template(
27 messages,
28 tokenize=True,
29 add_generation_prompt=True,
30 return_tensors="pt"
31).to("cuda")
32
33outputs = model.generate(
34 input_ids=inputs,
35 max_new_tokens=500,
36 temperature=0.7,
37 do_sample=True,
38)
39print(tokenizer.decode(outputs[0][inputs.shape[1]:], skip_special_tokens=True))1from unsloth import FastLanguageModel
2
3model, tokenizer = FastLanguageModel.from_pretrained(
4 model_name = "DhruvalLabs/qwen3-8b-claude-agentic-fable5",
5 max_seq_length = 8192,
6 load_in_4bit = True,
7)
8FastLanguageModel.for_inference(model)1python -m vllm.entrypoints.openai.api_server \
2 --model DhruvalLabs/qwen3-8b-claude-agentic-fable5 \
3 --port 8000 \
4 --max-model-len 8192http://localhost:8000/v1.Check if Node.js is installed and what version it is.<tool_call>
{"name": "bash", "arguments": {"command": "node --version 2>/dev/null || echo 'Node.js not installed'"}}
</tool_call>/think at the start of your user message to trigger reasoning modetemperature=0.7 for a good balance of creativity and consistencymax_new_tokens to at least 400 for complex tasks1@misc{dhruval2026qwen3fable5,
2 author = {DhruvalLabs},
3 title = {qwen3-8b-claude-agentic-fable5: Qwen3-8B Fine-tuned on Fable-5 Agent Traces},
4 year = {2026},
5 publisher = {HuggingFace},
6 url = {https://huggingface.co/DhruvalLabs/qwen3-8b-claude-agentic-fable5}
7}