This is the Aya-8B model, originally designed for Ollama and converted to be compatible with Hugging Face. Aya is an open-source language model known for its conversational abilities and text generation capabilities.
1from transformers import AutoModelForCausalLM, AutoTokenizer
2
3tokenizer = AutoTokenizer.from_pretrained("Danna8/aya-8b")
4model = AutoModelForCausalLM.from_pretrained("Danna8/aya-8b")
5
6inputs = tokenizer("Hello, how are you today?", return_tensors="pt")
7outputs = model.generate(inputs["input_ids"], max_length=100)
8response = tokenizer.decode(outputs[0], skip_special_tokens=True)
9print(response)
Like all language models, Aya-8B may reproduce biases present in its training data. Users should be aware of these limitations when deploying the model.