Local AI Glossary
What is PPO (Proximal Policy Optimization)?
Source: paperswithcode/PPO
The reinforcement learning algorithm used in RLHF. Trains the language model to maximize the reward model's output while staying close to the original model via a KL-divergence penalty.
How PPO (Proximal Policy Optimization) fits in the local AI stack
PPO (Proximal Policy Optimization) is part of the broader local AI ecosystem. See the related guides, comparisons, and tools below to see how it applies in practice.
See also
- Full Local AI Glossary
- All learn topics
- What is Local AI?
- Quantization explained
- Hardware requirements
- How to choose a local LLM