Views
No views yet
Priority, Tags, and Department.Priority: Low, Tags: ['Hardware', 'Peripherals'], Department: IT Support.1from unsloth import FastLanguageModel
2
3model, tokenizer = FastLanguageModel.from_pretrained(
4 model_name = "your-username/voc-triage-llama3-8b", # Replace with your repo!
5 max_seq_length = 2048,
6 dtype = None,
7 load_in_4bit = True,
8)
9FastLanguageModel.for_inference(model)