Below is an instruction that describes a task, paired with an input that provides further context. Write a response that appropriately completes the request.

### Instruction:
{instruction}

### Response:

Usage

python

from transformers import AutoModelForCausalLM, AutoTokenizer

model = AutoModelForCausalLM.from_pretrained(
    "Inkersion/llama-3.1-8b-alpaca-custom",
    device_map="auto",
    load_in_4bit=True
)
tokenizer = AutoTokenizer.from_pretrained("Inkersion/llama-3.1-8b-alpaca-custom")

prompt = """Below is an instruction that describes a task, paired with an input that provides further context. Write a response that appropriately completes the request.

### Instruction:
Explain what machine learning is in one sentence.

### Response:
"""

inputs = tokenizer(prompt, return_tensors="pt").to("cuda")
outputs = model.generate(**inputs, max_length=200)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))

Training Configuration

Learning Rate: 2e-4
Batch Size: 2 (per device)
Gradient Accumulation: 4 steps
Optimizer: AdamW 8-bit
Max Sequence Length: 2048

Trained using Unsloth for optimized fine-tuning.