Effect of SAPO on training effect of extreme samples and long-tail distribution

The Qwen team proposed Soft Adaptive Policy Optimization to improve the stability of large model RL

The paper on the Soft Adaptive Policy Optimization (SAPO) algorithm was published on arXiv, and then the Qwen team introduced this reinforcement learn...