You can deploy this model and start earning money today!

tkwiecinski/
amr-fma-Llama-3.1-8B-Instruct-lora_sdpo-math-p1_sdpo_math_l3plus-s42

Name: amr-fma-Llama-3.1-8B-Instruct-lora_sdpo-math-p1_sdpo_math_l3plus-s42
Availability: InStock

meta-llama/Llama-3.1-8B-Instruct

adapter

Views

No views yet

tkwiecinski/amr-fma-Llama-3.1-8B-Instruct-lora_sdpo-math-p1_sdpo_math_l3plus-s42

amr-fma training run.

Method: lora_sdpo
Base model: meta-llama/Llama-3.1-8B-Instruct
Dataset: DigitalLearningGmbH/MATH-lighteval (slug: math)
Seed: 42
Git commit: 8b979a30de6dfbf3b5a1052e42d8c0453b214d3f
Exp name: p1_sdpo_math_l3plus
WandB run: 0ershpx8

Checkpoints (branches)

step 1 → revision step-00001
step 3 → revision step-00003
step 6 → revision step-00006
step 12 → revision step-00012
step 22 → revision step-00022
step 42 → revision step-00042
step 79 → revision step-00079
step 80 → revision step-00080

Pin a specific checkpoint with revision=... in AutoModelForCausalLM.from_pretrained / PeftModel.from_pretrained.

Hyperparameter sections

checkpointing, dataset, evaluation, final_adapter_path, lora, model, optimization, prompt_style, runtime, sdpo, sequence, total_steps

tkwiecinski/amr-fma-Llama-3.1-8B-Instruct-lora_sdpo-math-p1_sdpo_math_l3plus-s42

tkwiecinski/amr-fma-Llama-3.1-8B-Instruct-lora_sdpo-math-p1_sdpo_math_l3plus-s42

Tags

Checkpoints (branches)

Hyperparameter sections

tkwiecinski/
amr-fma-Llama-3.1-8B-Instruct-lora_sdpo-math-p1_sdpo_math_l3plus-s42