You can deploy this model and start earning money today!

amr-fma/
amr-fma-Llama-3.1-8B-Instruct-lora_sft-pku_saferlhf-p1_lora_r16_all_datasets-s42

Method: lora_sft
Base model: meta-llama/Llama-3.1-8B-Instruct
Dataset: PKU-Alignment/PKU-SafeRLHF (slug: pku_saferlhf )
Seed: 42
Git commit: c0efb2a3dc00130e9ea87593f62ce7f9ae150564
Exp name: p1_lora_r16_all_datasets
WandB run: ffhxc4ll

Name: amr-fma-Llama-3.1-8B-Instruct-lora_sft-pku_saferlhf-p1_lora_r16_all_datasets-s42
Availability: InStock

Views

No views yet

amr-fma/amr-fma-Llama-3.1-8B-Instruct-lora_sft-pku_saferlhf-p1_lora_r16_all_datasets-s42

amr-fma training run.

Pin a specific checkpoint with revision=... in AutoModelForCausalLM.from_pretrained / PeftModel.from_pretrained.

checkpointing, dataset, evaluation, lora, model, optimization, runtime, sequence