Views
No views yet
LlamaForCausalLMllamafloat16204832002model.safetensorsconfig.jsongeneration_config.jsontokenizer.jsontokenizer.modeltokenizer_config.jsonspecial_tokens_map.jsonadded_tokens.json<|noesis|> (id 32000)<|end|> (id 32001)1{% for message in messages %}<|noesis|>
2### Domanda
3{{ message['content'] }}
4
5### Risposta
6{% endfor %}1<|noesis|>
2### Domanda
3Spiega cos'e una funzione in Python.
4
5### Risposta1import torch
2from transformers import AutoTokenizer, AutoModelForCausalLM
3
4model_id = "RthItalia/PINDARO-HF"
5
6tokenizer = AutoTokenizer.from_pretrained(model_id)
7model = AutoModelForCausalLM.from_pretrained(
8 model_id,
9 torch_dtype=torch.float16,
10)
11
12prompt = "<|noesis|>
13### Domanda
14Spiega cos'e una funzione in Python.
15
16### Risposta
17"
18
19inputs = tokenizer(prompt, return_tensors="pt")
20
21# pad_token_id == eos_token_id for this model: pass attention_mask explicitly.
22outputs = model.generate(
23 **inputs,
24 attention_mask=inputs["attention_mask"],
25 max_new_tokens=120,
26 do_sample=False,
27)
28
29print(tokenizer.decode(outputs[0], skip_special_tokens=False))model.safetensors: 778e5547c238d0e19738479562cdc310a38f5ee4c5354294a23dfccc92626e87config.json: ae832c409e0d6ad9c8881ec2bd287a8d7e7e9012b712513532cd3ad352ca0655generation_config.json: 6ff47e725c0ec6d0f1895670de7ee68e61a4f99703f6c8e89aea6ab14ea02dc3tokenizer.json: 51433f06369ac3e597dfa23a811215e3511b8f86588a830ded72344b76a193eetokenizer.model: 9e556afd44213b6bd1be2b850ebbbd98f5481437a8021afaf58ee7fb1818d347tokenizer_config.json: 02ca6d3ddfa1112eec7bd5f22a0e682338b5b2da8ddb6761e9d25e6d7b8188d0special_tokens_map.json: d7805e093432afcde852968cdeba3de08a6fe66e77609f4701decb87fc492f33added_tokens.json: ece349d292e246eac9a9072c1730f023e61567984a828fb0d25dccb14e3b7592