Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
Qwen_2_5_1_5b_cot_PPO_step_50_critic – AI Model by BobHuangC | AlphaNeural AI
You can deploy this model and start earning money today!
BobHuangC
/
Qwen_2_5_1_5b_cot_PPO_step_50_critic
like
0
safetensors
qwen2
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
这个目录下的模型是我利用
https://huggingface.co/wh-zhu/qwen2.5-1.5b-cot
使用 verl 框架, 使用 PPO 算法在 GSM8K 数据集上训练 50 个 step 得到的 Critic 模型.
对应的参数见:
https://wandb.ai/bohuang/qwen_2_5_1_5b_cot_PPO/runs/65v9s1wo?nw=nwuserbohuang