Views
No views yet
[flash] prefix: gives direct answers with internal reasoning[think] prefix: shows full reasoning steps before the answer1from transformers import AutoModelForImageTextToText, AutoProcessor
2from peft import PeftModel
3
4model = AutoModelForImageTextToText.from_pretrained("Qwen/Qwen2.5-VL-7B-Instruct", dtype="bfloat16", device_map="auto")
5model = PeftModel.from_pretrained(model, "ggufs/mantis-m1-flash-lora")