from llama_cpp import Llama

llm = Llama(
    model_path="Llama-3.2-3B-Psychology-FP16.gguf",
    n_ctx=2048,
    n_threads=8
)

# Retrieve context from psychology textbook first
context = "..." # Your RAG context here

prompt = f"""[INST] The following context is from a psychology textbook:

{context}

Based on the context above, generate 1 multiple-choice question about classical conditioning.
[/INST]"""

output = llm(prompt, max_tokens=250, temperature=0.2)
print(output['choices'][0]['text'])

Important Notes

This model was fine-tuned to work WITH RAG (textbook context)
Best results require providing relevant psychology textbook excerpts
For production use, consider the Q4_K_M quantized version for faster inference

ahmedhugging12/Llama-3.2-3B-Psychology-GGUF

Llama-3.2-3B Psychology Quiz Generator (FP16 GGUF)

Model Details

Usage with llama.cpp

Important Notes

ahmedhugging12/
Llama-3.2-3B-Psychology-GGUF