Views
No views yet
Created by Ahmad Abdo Shbat
<think>...</think> tags before the final answer, enabling transparent chain-of-thought.```tia-widget code blocks for rich interactive explanations.<options> / <options multi> tags to ask structured single-select or multi-select clarifying questions when requests are ambiguous.<deep_search_results> context using [N] references.| File | Quantization | Size |
|---|---|---|
tia2.1-14b-q8_0.gguf | Q8_0 | ~15 GB |
1# Create a Modelfile
2cat > Modelfile << 'EOF'
3FROM ./tia2.1-14b-q8_0.gguf
4
5TEMPLATE """{{- if .System }}<|im_start|>system
6{{ .System }}<|im_end|>
7{{ end }}{{- range .Messages }}<|im_start|>{{ .Role }}
8{{ .Content }}<|im_end|>
9{{ end }}<|im_start|>assistant
10"""
11
12PARAMETER stop "<|im_end|>"
13PARAMETER stop "<|im_start|>"
14PARAMETER stop "<|endoftext|>"
15PARAMETER num_ctx 4096
16PARAMETER temperature 0.6
17PARAMETER top_p 0.9
18PARAMETER repeat_penalty 1.05
19EOF
20
21# Create and run
22ollama create tia2.1:14b -f Modelfile
23ollama run tia2.1:14b1./llama-cli -m tia2.1-14b-q8_0.gguf \
2 --ctx-size 4096 \
3 --temp 0.6 \
4 --top-p 0.9 \
5 --repeat-penalty 1.05 \
6 -p "<|im_start|>user\nExplain how a ROP chain bypasses DEP on x86-64<|im_end|>\n<|im_start|>assistant\n"You are a conversational chat assistant. Think step-by-step inside <think>...</think> before every answer. Reply in the same language the user writes in (English or Arabic). Be concise, helpful, and accurate. Answer all questions fully and directly.| Quantization | VRAM (approx) | RAM (approx) |
|---|---|---|
| Q8_0 | ~16 GB | ~17 GB |
tia-widget) requires a compatible frontend to render interactive visualizations[N]) requires a search-augmented pipeline to provide <deep_search_results> context