from unsloth import FastLanguageModel
model, tokenizer = FastLanguageModel.from_pretrained(
    model_name = "sujeetgund/llama_3_lora_model",
    max_seq_length = 1024,
    load_in_4bit = True,
)
FastLanguageModel.for_inference(model)

About Unsloth

Developed by: <a href="https://huggingface.co/sujeetgund" target="_blank" rel="noopener noreferrer" class="text-blue-400 hover:text-blue-300 underline underline-offset-2 transition-colors">sujeetgund
Model type: Causal Language Model
Language(s) (NLP): English
License: Apache 2.0

Fine-tuned with Unsloth. Unsloth makes fine-tuning Llama-3, Mistral, and Gemma models 2x faster and use 70% less memory.