Views
No views yet
model_stock.LlamaForCasualLM1from transformers import AutoModelForCausalLM, AutoTokenizer
2import torch
3
4model = AutoModelForCausalLM.from_pretrained("leafspark/IridiumLlama-72B-v0.1",
5 device_map="auto",
6 torch_dtype=torch.float16)
7tokenizer = AutoTokenizer.from_pretrained("leafspark/IridiumLlama-72B-v0.1")