You can deploy this model and start earning money today!

tkwiecinski/
amr-fma-Mistral-7B-Instruct-v0.3-lora_sdpo-math-p1_sdpo_math_l3plus-s42

Name: amr-fma-Mistral-7B-Instruct-v0.3-lora_sdpo-math-p1_sdpo_math_l3plus-s42
Availability: InStock

mistralai/Mistral-7B-Instruct-v0.3

adapter

Views

No views yet

tkwiecinski/amr-fma-Mistral-7B-Instruct-v0.3-lora_sdpo-math-p1_sdpo_math_l3plus-s42

amr-fma training run.

Method: lora_sdpo
Base model: mistralai/Mistral-7B-Instruct-v0.3
Dataset: DigitalLearningGmbH/MATH-lighteval (slug: math)
Seed: 42
Git commit: 8b979a30de6dfbf3b5a1052e42d8c0453b214d3f
Exp name: p1_sdpo_math_l3plus
WandB run: 02olkt1m

Checkpoints (branches)

step 1 → revision step-00001
step 3 → revision step-00003
step 6 → revision step-00006
step 12 → revision step-00012
step 22 → revision step-00022
step 42 → revision step-00042
step 79 → revision step-00079
step 80 → revision step-00080

Pin a specific checkpoint with revision=... in AutoModelForCausalLM.from_pretrained / PeftModel.from_pretrained.

Hyperparameter sections

checkpointing, dataset, evaluation, final_adapter_path, lora, model, optimization, prompt_style, runtime, sdpo, sequence, total_steps

tkwiecinski/amr-fma-Mistral-7B-Instruct-v0.3-lora_sdpo-math-p1_sdpo_math_l3plus-s42

tkwiecinski/amr-fma-Mistral-7B-Instruct-v0.3-lora_sdpo-math-p1_sdpo_math_l3plus-s42

Tags

Checkpoints (branches)

Hyperparameter sections

tkwiecinski/
amr-fma-Mistral-7B-Instruct-v0.3-lora_sdpo-math-p1_sdpo_math_l3plus-s42