Views
No views yet
NousResearch/Meta-Llama-3-8B using LoRA and 8-bit quantization.1from transformers import AutoModelForCausalLM, AutoTokenizer
2
3model_name = "ubiodee/Test_Plutus"
4model = AutoModelForCausalLM.from_pretrained(model_name, trust_remote_code=True)
5tokenizer = AutoTokenizer.from_pretrained(model_name)