A small (~543M parameter) GLM-4 MoE model for testing
prime-rl integration with HuggingFace Transformers and vLLM.
The model has been fine-tuned on
PrimeIntellect/Reverse-Text-SFT to provide a non-trivial distribution for KL divergence during RL.
1# Run RL with reverse-text environment
2uv run rl @ configs/ci/integration/rl_moe/glm4_moe.toml
See the
Testing MoE at Small Scale guide for full instructions.
