You can deploy this model and start earning money today!

amr-fma/
amr-fma-Llama-3.1-8B-Instruct-lora_sdpo-gsm8k-debug_sdpo_quick-s42

Method: lora_sdpo
Base model: meta-llama/Llama-3.1-8B-Instruct
Dataset: openai/gsm8k (slug: gsm8k )
Seed: 42
Git commit: 9e910a3030d37320b8ab3c7479359f38b11703dc
Exp name: debug_sdpo_quick
WandB run: uvozx2a5

Name: amr-fma-Llama-3.1-8B-Instruct-lora_sdpo-gsm8k-debug_sdpo_quick-s42
Availability: InStock

Views

No views yet

amr-fma/amr-fma-Llama-3.1-8B-Instruct-lora_sdpo-gsm8k-debug_sdpo_quick-s42

amr-fma training run.

Pin a specific checkpoint with revision=... in AutoModelForCausalLM.from_pretrained / PeftModel.from_pretrained.

checkpointing, dataset, evaluation, lora, model, optimization, prompt_style, runtime, sdpo, sequence