Views
No views yet
smol3-no-think1<|im_start|>system
2## Metadata
3
4Knowledge Cutoff Date: June 2025
5Today Date: 15 July 2025
6Reasoning Mode: /no_think
7
8## Custom Instructions
9
10You are a helpful AI assistant named SmolLM, trained by Hugging Face.
11<|im_end|>
12<|im_start|>user
13{user_message_1}
14<|im_end|>
15<|im_start|>assistant
16{assistant_message_1}
17<|im_end|>
18<|im_start|>user
19{user_message_2}
20<|im_end|>
21<|im_start|>assistantsmol3-no-think1<|im_start|>system
2## Metadata
3
4Knowledge Cutoff Date: June 2025
5Today Date: 15 July 2025
6Reasoning Mode: /no_think
7
8## Custom Instructions
9
10You are a helpful AI assistant named SmolLM, trained by Hugging Face.
11
12### Tools
13
14You may call one or more functions to assist with the user query.
15You are provided with function signatures within <tools></tools> XML tags:
16
17<tools>
18{"name":"sum","description":"Calculate the sum of two numbers","parameters":{"$schema":"http://json-schema.org/draft-07/schema#","properties":{"a":{"description":"The left hand side number","format":"int32","type":"integer"},"b":{"description":"The right hand side number","format":"int32","type":"integer"}},"required":["a","b"],"title":"SumRequest","type":"object"}}
19{"name":"sub","description":"Calculate the difference of two numbers","parameters":{"$schema":"http://json-schema.org/draft-07/schema#","properties":{"a":{"description":"The left hand side number","format":"int32","type":"integer"},"b":{"description":"The right hand side number","format":"int32","type":"integer"}},"required":["a","b"],"title":"SubRequest","type":"object"}}
20{"name":"get_current_weather","description":"Get the weather for a given city","parameters":{"$schema":"http://json-schema.org/draft-07/schema#","definitions":{"TemperatureUnit":{"enum":["celsius","fahrenheit"],"type":"string"}},"properties":{"location":{"description":"the city to get the weather for, e.g., 'Beijing', 'New York', 'Tokyo'","type":"string"},"unit":{"$ref":"#/definitions/TemperatureUnit","description":"the unit to use for the temperature, e.g., 'celsius', 'fahrenheit'"}},"required":["location","unit"],"title":"GetWeatherRequest","type":"object"}}
21</tools>
22
23For each function call, return a json object with function name and arguments within <tool_call></tool_call> XML tags:
24<tool_call>
25{"name": <function-name>, "arguments": <args-json-object>}
26</tool_call>
27
28<|im_end|>
29<|im_start|>user
30{user_message_1}
31<|im_end|>
32<|im_start|>assistant
33{assistant_message_1}
34<|im_end|>
35<|im_start|>user
36{user_message_2}
37<|im_end|>
38<|im_start|>assistant```1280001wasmedge --dir .:. --nn-preload default:GGML:AUTO:SmolLM3-3B-Q5_K_M.gguf \
2 llama-api-server.wasm \
3 --model-name SmolLM3-3B \
4 --prompt-template smol3-no-think \
5 --ctx-size 1280001wasmedge --dir .:. --nn-preload default:GGML:AUTO:SmolLM3-3B-Q5_K_M.gguf \
2 llama-chat.wasm \
3 --prompt-template smol3-no-think \
4 --ctx-size 128000| Name | Quant method | Bits | Size | Use case |
|---|---|---|---|---|
| SmolLM3-3B-Q2_K.gguf | Q2_K | 2 | 1.25 GB | smallest, significant quality loss - not recommended for most purposes |
| SmolLM3-3B-Q3_K_L.gguf | Q3_K_L | 3 | 1.69 GB | small, substantial quality loss |
| SmolLM3-3B-Q3_K_M.gguf | Q3_K_M | 3 | 1.57 GB | very small, high quality loss |
| SmolLM3-3B-Q3_K_S.gguf | Q3_K_S | 3 | 1.43 GB | very small, high quality loss |
| SmolLM3-3B-Q4_0.gguf | Q4_0 | 4 | 1.81 GB | legacy; small, very high quality loss - prefer using Q3_K_M |
| SmolLM3-3B-Q4_K_M.gguf | Q4_K_M | 4 | 1.92 GB | medium, balanced quality - recommended |
| SmolLM3-3B-Q4_K_S.gguf | Q4_K_S | 4 | 1.82 GB | small, greater quality loss |
| SmolLM3-3B-Q5_0.gguf | Q5_0 | 5 | 2.16 GB | legacy; medium, balanced quality - prefer using Q4_K_M |
| SmolLM3-3B-Q5_K_M.gguf | Q5_K_M | 5 | 2.21 GB | large, very low quality loss - recommended |
| SmolLM3-3B-Q5_K_S.gguf | Q5_K_S | 5 | 2.16 GB | large, low quality loss - recommended |
| SmolLM3-3B-Q6_K.gguf | Q6_K | 6 | 2.53 GB | very large, extremely low quality loss |
| SmolLM3-3B-Q8_0.gguf | Q8_0 | 8 | 3.28 GB | very large, extremely low quality loss - not recommended |
| SmolLM3-3B-f16.gguf | f16 | 16 | 6.16 GB |