Views
No views yet
artifacts/checkpoints/sft/run1_stage2/model.safetensorsLlamaTokenizer, model_max_length=2048).1from transformers import AutoModelForCausalLM, AutoTokenizer
2
3repo = "AuraWorxAI/weather-llama-sft-root-run1-stage2"
4model = AutoModelForCausalLM.from_pretrained(repo, torch_dtype="auto", device_map="auto")
5tokenizer = AutoTokenizer.from_pretrained(repo)transformers (Llama + SentencePiece) and sentencepiece.