Views
No views yet
adapter_model.safetensors – LoRA adapter weightstokenizer.model – Tokenizer modeltokenizer.json – Tokenizer JSON configadapter_config.json – LoRA configuration (moved to configs/)tokenizer_config.json – Tokenizer configuration (moved to configs/)special_tokens_map.json – Special tokens mapping (moved to configs/)chat_template.jinja – Conversation template for inferenceREADME.md – Model card and instructions1from transformers import AutoModelForCausalLM, AutoTokenizer
2import torch
3
4model_name = "AbdulSittar/llama2-lora-covid"
5
6# Load tokenizer
7tokenizer = AutoTokenizer.from_pretrained("configs")
8
9# Load model
10model = AutoModelForCausalLM.from_pretrained(model_name, device_map="auto")
11model.eval()
12
13prompt = "Latest COVID-19 variants and vaccines:"
14inputs = tokenizer(prompt, return_tensors="pt").to(model.device)
15outputs = model.generate(**inputs, max_new_tokens=200)
16print(tokenizer.decode(outputs[0], skip_special_tokens=True))