I highly recommend you to use our flagship 3B model instead:
https://huggingface.co/Pinkstack/PARM-V2-QwQ-Qwen-2.5-o1-3B-GGUF <- this model has generally better performance and is higher quality.
Further trained Llama 3.2 3B with enhanced reasoning, aimed to mimic deepseek r1 quality.
This is the first model we've trained it may have abnormalities, Phi 3.5 soon.
This llama model was trained using
Unsloth and Huggingface's TRL library.