Views
No views yet
tinyllama-1.1b is a compact and efficient transformer-based model designed for high-performance language tasks. It is optimized for resource-constrained environments while maintaining robust accuracy across a variety of natural language processing benchmarks.1from transformers import AutoModelForCausalLM, AutoTokenizer
2
3# Load the base model
4base_model_path = "path/to/tinyllama-1.1b"
5model = AutoModelForCausalLM.from_pretrained(base_model_path)
6tokenizer = AutoTokenizer.from_pretrained(base_model_path)
7
8# Example usage
9inputs = tokenizer("Hello, world!", return_tensors="pt")
10outputs = model.generate(inputs["input_ids"])
11print(tokenizer.decode(outputs[0]))