https://wyxbupt.me/tags/ppo/记录 LLM、Agentic RL、通信与工程实践的个人技术博客。Hugozh-CNMon, 27 Jul 2026 00:00:00 +0800https://wyxbupt.me/posts/agentic-rl/understanding-ppo/Mon, 04 May 2026 00:00:00 +0800https://wyxbupt.me/posts/agentic-rl/understanding-ppo/从策略梯度、优势函数和 GAE 出发，推导 PPO 的概率比与 clipped objective，并说明它为何仍是 on-policy 算法。