This model is obtained by merging
SamsungSAILMontreal/Qwen3-0.6B-Math and
SamsungSAILMontreal/Qwen3-0.6B-Fr.
The model is used in the experiments described in
https://bknyaz.github.io/blog/2026/meta-merge/.
Single A100 was used for merging and evaluation.
Merging was done using parameter averaging implemented in
merge_qwen.py.
Evaluation was done with lm_eval on the test split of
gsm8k,
french_bench (avg score) and
gsm8k-fr:
1python -m lm_eval --model vllm --model_args pretrained=${model},tensor_parallel_size=1,dtype=auto,gpu_memory_utilization=0.9,data_parallel_size=1 \
2 --tasks gsm8k,french_bench,gsm8k-fr --batch_size 1 --apply_chat_template=True --confirm_run_unsafe_code --trust_remote_code
