You can deploy this model and start earning money today!

tkwiecinski/
amr-fma-Llama-3.1-8B-Instruct-lora_sdpo-gsm8k-p1_sdpo_multimodel_trial-s42

Name: amr-fma-Llama-3.1-8B-Instruct-lora_sdpo-gsm8k-p1_sdpo_multimodel_trial-s42
Availability: InStock

meta-llama/Llama-3.1-8B-Instruct

adapter

Views

No views yet

tkwiecinski/amr-fma-Llama-3.1-8B-Instruct-lora_sdpo-gsm8k-p1_sdpo_multimodel_trial-s42

amr-fma training run.

Method: lora_sdpo
Base model: meta-llama/Llama-3.1-8B-Instruct
Dataset: openai/gsm8k (slug: gsm8k)
Seed: 42
Git commit: 0a703a3b9fa4a2fe6be6ab5621e40883fd67118c
Exp name: p1_sdpo_multimodel_trial
WandB run: 8ftkdew3

Checkpoints (branches)

step 1 → revision step-00001
step 3 → revision step-00003
step 5 → revision step-00005
step 10 → revision step-00010
step 19 → revision step-00019
step 35 → revision step-00035
step 63 → revision step-00063
step 64 → revision step-00064

Pin a specific checkpoint with revision=... in AutoModelForCausalLM.from_pretrained / PeftModel.from_pretrained.

Hyperparameter sections

checkpointing, dataset, evaluation, final_adapter_path, lora, model, optimization, prompt_style, runtime, sdpo, sequence, total_steps

tkwiecinski/amr-fma-Llama-3.1-8B-Instruct-lora_sdpo-gsm8k-p1_sdpo_multimodel_trial-s42

tkwiecinski/amr-fma-Llama-3.1-8B-Instruct-lora_sdpo-gsm8k-p1_sdpo_multimodel_trial-s42

Tags

Checkpoints (branches)

Hyperparameter sections

tkwiecinski/
amr-fma-Llama-3.1-8B-Instruct-lora_sdpo-gsm8k-p1_sdpo_multimodel_trial-s42