This is a model uploaded from /mnt/nanjingcephfs/project_wx-rec-alg-bdc-exp/bwzheng/yulan/hyw/Ubiquant-Pretrain/build/wjp-share/output_mcore_qwen2.5_pretrain/checkpoint/avg-embedding-trainable-2025.10.11-21.30.19-pretrain-mcore-qwen2.5-0.5B-lr-1e-5-minlr-1e-6-bs-4-gbs-1024-seqlen-8192-pr-bf16-tp-1-pp-1-cp-1-ac-sel-do-true-sp-false-ti-1192-wi-119/huggingface/qwen2-0.5b-using-llam2-modeling.