Views
No views yet
| Task | Saif-1.0 | Saif-1.1 |
|---|---|---|
| Prime check (Python) | ✓ slower | ✓ faster, better algo |
| Derivative (Math) | ✓ 9.64s | ✓ 3.87s |
| Factorial (JavaScript) | ✓ 15.51s | ✓ 7.72s |
1from transformers import AutoTokenizer, AutoModelForCausalLM
2import torch
3
4tokenizer = AutoTokenizer.from_pretrained("Saif658/Saif-1.1")
5model = AutoModelForCausalLM.from_pretrained(
6 "Saif658/Saif-1.1",
7 torch_dtype=torch.float16,
8 device_map="auto"
9)
10
11messages = [{"role": "user", "content": "your message here"}]
12inputs = tokenizer.apply_chat_template(messages, return_tensors="pt").to("cuda")
13outputs = model.generate(inputs, max_new_tokens=200)
14print(tokenizer.decode(outputs[0], skip_special_tokens=True))