Views
No views yet
| Paramètre | Valeur |
|---|---|
| Modèle de base | mistralai/Mistral-7B-Instruct-v0.3 |
| Technique | QLoRA (4-bit) via Unsloth |
| Dataset | 1822 exemples cybersécurité |
| Epochs | 3 |
| GPU | NVIDIA RTX 4000 Ada 21GB |
| LoRA rank | r=16, alpha=32 |
1from unsloth import FastLanguageModel
2from unsloth.chat_templates import get_chat_template
3from peft import PeftModel
4import torch
5
6model, tokenizer = FastLanguageModel.from_pretrained(
7 model_name="mistralai/Mistral-7B-Instruct-v0.3",
8 max_seq_length=2048, dtype=None, load_in_4bit=True,
9)
10model = PeftModel.from_pretrained(model, "gabinkebre/cybersec-mistral-7b-v6")
11FastLanguageModel.for_inference(model)
12tokenizer = get_chat_template(tokenizer, chat_template="mistral")
13
14messages = [{"role": "user", "content": "Comment fonctionne le Kerberoasting ?"}]
15inputs = tokenizer.apply_chat_template(messages, tokenize=True,
16 add_generation_prompt=True, return_tensors="pt").to("cuda")
17outputs = model.generate(input_ids=inputs, max_new_tokens=500,
18 temperature=0.7, do_sample=True, pad_token_id=tokenizer.eos_token_id)
19print(tokenizer.decode(outputs[0][inputs.shape[1]:], skip_special_tokens=True))Usage éducatif uniquement. Toute utilisation malveillante est interdite.