Views
No views yet
ibm-granite/granite-4.0-350m
that classifies a described GenAI security incident into one of 14 attack-vector
classes (a closed set).input_linear / output_linear MLP projections.| Metric | Score |
|---|---|
| Accuracy | 74.8% (166 / 222) |
| Macro-precision | 77.4 |
| Macro-recall | 74.9 |
| Macro-F1 | 75.1 |
| Malformed generations | 0 |
1from peft import PeftModel
2from transformers import AutoModelForCausalLM, AutoTokenizer
3
4base = "ibm-granite/granite-4.0-350m"
5tok = AutoTokenizer.from_pretrained(base)
6model = AutoModelForCausalLM.from_pretrained(base, device_map="cuda")
7model = PeftModel.from_pretrained(model, "barha/granite-genai-attack-vector-350m-lora")
8
9messages = [{"role": "user", "content": "<incident description here>"}]
10inputs = tok.apply_chat_template(messages, add_generation_prompt=True, return_tensors="pt").to("cuda")
11out = model.generate(inputs, max_new_tokens=32)
12print(tok.decode(out[0, inputs.shape[1]:], skip_special_tokens=True))ibm-granite/granite-4.0-350mq_proj, k_proj, v_proj, o_proj, input_linear, output_linearemmanuelgjr/genai-incidents