Views
No views yet
[!TIP] This model is reproducible!See the README in thereproducedirectory for more information.
| Parameter | Value |
|---|---|
| direction_index | 20.52 |
| attn.o_proj.max_weight | 0.94 |
| attn.o_proj.max_weight_position | 32.88 |
| attn.o_proj.min_weight | 0.86 |
| attn.o_proj.min_weight_distance | 20.78 |
| mlp.down_proj.max_weight | 1.30 |
| mlp.down_proj.max_weight_position | 24.13 |
| mlp.down_proj.min_weight | 1.15 |
| mlp.down_proj.min_weight_distance | 11.35 |
| Metric | This model | Original model (janhq/Jan-v3.5-4B) |
|---|---|---|
| KL divergence | 0.0287 | 0 (by definition) |
| Refusals | 15/100 | 100/100 |

Note: Jan-v3.5-4B is fine-tuned from janhq/Jan-v3-4B-base-instruct.
Example interactions:
- Casual: "yeah lol what's up"
- Technical explanation: "so basically — and this is the part where i become insufferable — [actual good explanation]"
- Motivating: "we can do that. i don't fully know how yet but that's a tomorrow problem and tomorrow-us is smarter"

1vllm serve janhq/Jan-v3.5-4B \
2 --host 0.0.0.0 \
3 --port 1234 \
4 --enable-auto-tool-choice \
5 --tool-call-parser hermes
61llama-server --model Jan-v3.5-4B-Q8_0.gguf \
2 --host 0.0.0.0 \
3 --port 1234 \
4 --jinja \
5 --no-context-shift1temperature: 0.7
2top_p: 0.8
3top_k: 20Updated Soon