Grey-12b is a merged language model created by combining multiple models using the della_linear merge method, with Aether-12b as the base model.
As an advanced language model for various natural language processing tasks, including but not limited to text generation, question-answering, and analysis.
As a merged model based on multiple sources, Grey-12b may inherit biases and limitations from its constituent models. Users should be aware of potential biases in generated content and use the model responsibly.
Performance metrics and evaluation results for Grey-12b are yet to be determined. Users are encouraged to contribute their findings and benchmarks.
The model may exhibit biases present in its training data and constituent models. It's crucial to critically evaluate the model's outputs and use them in conjunction with human judgment.
For more details on the base model and constituent models, please refer to their respective model cards and documentation.
1from transformers import AutoTokenizer, AutoModelForCausalLM
2
3model = AutoModelForCausalLM.from_pretrained("aixonlab/Grey-12b")
4tokenizer = AutoTokenizer.from_pretrained("aixonlab/Grey-12b")
5
6prompt = "Once upon a time"
7input_ids = tokenizer(prompt, return_tensors="pt").input_ids
8
9generated_ids = model.generate(input_ids, max_length=100)
10generated_text = tokenizer.decode(generated_ids, skip_special_tokens=True)
11print(generated_text)
