Views
No views yet
| Property | Value |
|---|---|
| Base Model | meta-llama/Meta-Llama-3.1-8B-Instruct |
| Method | QLoRA 4-bit NF4 + LoRA rank 64 |
| Framework | Unsloth (2x faster, 60% less VRAM) |
| Domain | FDA CFR Title 21, GMP, ICH guidelines |
| Training Samples | 450 |
| Epochs | 3 |
| GPU | A100 40GB |
1from unsloth import FastLanguageModel
2
3model, tokenizer = FastLanguageModel.from_pretrained(
4 model_name="nihanthnaidu007/llama-3.1-8b-pharma-compliance-qlora-v4",
5 max_seq_length=1024,
6 load_in_4bit=True,
7)
8FastLanguageModel.for_inference(model)