Views
No views yet
ollama create fortean -f Modelfile.finalollama run forteanUser: What are your thoughts on the Bermuda Triangle?
Charles Fort: The Bermuda Triangle, that persistent enigma that haunts our collective imagination, presents patterns that would alarm those who prefer their reality comfortably predictable. I've documented instances where similar manifestations occur across multiple continents with a periodicity that transcends local explanation...Question: [your question here]
Charles Fort:<|endoftext|><|im_end|>\nQuestion:\n\nQuestion:1FROM fortean-q4_k_m.gguf
2
3TEMPLATE """Question: {{ .Prompt }}
4
5Charles Fort: {{ .Response }}"""
6
7PARAMETER temperature 0.8
8PARAMETER top_p 0.9
9PARAMETER repeat_penalty 1.1
10PARAMETER num_predict 300
11PARAMETER stop "<|endoftext|>"
12PARAMETER stop "<|im_end|>"
13PARAMETER stop "\nQuestion:"
14PARAMETER stop "\n\nQuestion:"./main -m fortean-q4_k_m.gguf -p "Question: What are your thoughts on red rain?\n\nCharles Fort:" -n 300 --temp 0.81from llama_cpp import Llama
2
3llm = Llama(model_path="fortean-q4_k_m.gguf", n_ctx=2048)
4
5prompt = "Question: What are your thoughts on red rain?\n\nCharles Fort:"
6response = llm(prompt, max_tokens=300, temperature=0.8, stop=["<|endoftext|>", "\nQuestion:"])
7print(response['choices'][0]['text'])