Views
No views yet
1from transformers import AutoTokenizer, AutoModelForCausalLM, pipeline
2
3MODEL_NAME = "OtaneCrypto/mon-llm-simple"
4HF_TOKEN = "hf_xxxTONTOKENxxx"
5
6tokenizer = AutoTokenizer.from_pretrained(MODEL_NAME, use_auth_token=HF_TOKEN)
7model = AutoModelForCausalLM.from_pretrained(MODEL_NAME, use_auth_token=HF_TOKEN)
8
9generator = pipeline("text-generation", model=model, tokenizer=tokenizer)
10question = "Quels engrais sont efficaces pour le blé ?"
11response = generator(question, max_length=150)
12print(response[0]['generated_text'])
13
14---
15
16## 2. Fichiers générés automatiquement
17
18Quand tu fais :
19
20```python
21from transformers import AutoModelForCausalLM, AutoTokenizer
22
23# Télécharger GPT-2 pré-entraîné
24model = AutoModelForCausalLM.from_pretrained("gpt2")
25tokenizer = AutoTokenizer.from_pretrained("gpt2")
26
27# Sauvegarder localement
28model.save_pretrained("./mon-llm-simple")
29tokenizer.save_pretrained("./mon-llm-simple")