Views
No views yet
unsloth/Qwen2.5-Coder-7B-Instruct on cybersecurity datasets using Unsloth + LoRA.| Dataset | Examples |
|---|---|
| omurkuru/cve-security-data | 20,000 |
| Trendyol/Cybersecurity-Instruction | 10,000 |
| ethanolivertroy/nist-cybersecurity | 10,000 |
| Nitral-AI/Cybersecurity-ShareGPT | 10,000 |
| Vanessasml/cybersecurity_32k | 10,000 |
| jason-oneal/pentest-agent-dataset | 10,000 |
| Total | 70,000 |
1from transformers import AutoModelForCausalLM, AutoTokenizer
2
3model = AutoModelForCausalLM.from_pretrained(
4 "dennny123/cybersec-qwen2.5-coder-7b",
5 torch_dtype="auto",
6 device_map="auto"
7)
8tokenizer = AutoTokenizer.from_pretrained("dennny123/cybersec-qwen2.5-coder-7b")
9
10messages = [
11 {"role": "system", "content": "You are a cybersecurity expert assistant."},
12 {"role": "user", "content": "Explain CVE-2024-1234 and its impact"}
13]
14
15text = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
16inputs = tokenizer(text, return_tensors="pt").to(model.device)
17outputs = model.generate(**inputs, max_new_tokens=512)
18print(tokenizer.decode(outputs[0], skip_special_tokens=True))