This is a LoRA adapter fine-tuned on 100,000 synthetic instruction-style samples covering quality-management compliance analysis against ISO standards.

Completed by Aboutknowledge (Hong Kong) Limited — Alex Lee.

License note: the LoRA weights in this repository are released under the same terms as the base model, the Llama 3.2 Community License Agreement. Please review Meta's license before using or redistributing the merged weights.

Model details

Item	Value
Base model	`unsloth/Llama-3.2-3B-Instruct-bnb-4bit`
Fine-tuning framework	Unsloth
LoRA rank (r)	16
LoRA alpha	16
LoRA dropout	0.0
Quantized training	4-bit NF4 (bnb)
Training records	100,000
Training steps	1,000
Final train loss	0.2015
Sequence length	2048

Included files

adapter_model.safetensors / adapter_config.json — standard PEFT LoRA adapter.
compliance_analyzer.q8_0.gguf — Q8_0 GGUF file ready for Ollama.
Modelfile — example Ollama Modelfile (edit the FROM path after downloading).

Use with transformers / Unsloth

python

from unsloth import FastLanguageModel

model, tokenizer = FastLanguageModel.from_pretrained(
    model_name="unsloth/Llama-3.2-3B-Instruct-bnb-4bit",
    max_seq_length=2048,
    dtype=None,
    load_in_4bit=True,
)
model = FastLanguageModel.get_peft_model(model, r=16, lora_alpha=16)
model.load_adapter("alexlkc28/compliance-analyzer-llama32-3b", adapter_name="default")

messages = [
    {"role": "system", "content": "You are an expert quality-management auditor and ISO standards consultant. Analyze the user's statement for compliance with relevant ISO/quality-management requirements. Provide a verdict (compliant, partially_compliant, or non_compliant), cite the relevant clause(s), explain your reasoning, and list actionable recommendations."},
    {"role": "user", "content": "We do not document management review meetings."},
]
inputs = tokenizer.apply_chat_template(messages, return_tensors="pt", tokenize=True).to("cuda")
outputs = model.generate(inputs, max_new_tokens=256)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))

Use with Ollama

Download the GGUF and Modelfile from this repo.
Update the FROM line in the Modelfile to point to the downloaded GGUF path.
Create the model:

bash

ollama create compliance-analyzer -f /path/to/Modelfile
ollama run compliance-analyzer

Training data

The data was generated synthetically from a compact ISO/quality-management knowledge base covering:

ISO 9001, 14001, 45001, 27001, 13485, 50001
IATF 16949 (automotive), AS9100D (aerospace)
Compliance verdicts: compliant, partially_compliant, non_compliant
Structured output: verdict, cited clause(s), explanation, recommendations

The full 100,000-record dataset is available locally in the project directory as data/compliance_100k_chat.jsonl.

Limitations

Synthetic data can contain occasional grammar artifacts or mix standards in generic answers; always verify against the official standard text for compliance decisions.
This is a 3B model; while useful for drafting and triage, it should not replace human auditors or regulatory review.