Training & Learning
Reinforcement Learning from Human Feedback
RLHFA training method that tunes a model to be helpful by rewarding the responses human reviewers prefer.
RLHF shapes a models behavior using human judgments rather than a fixed set of correct answers. People compare the models outputs and mark which they prefer, those preferences train a reward model, and the main model is then optimized to score well against it. This is a big part of why modern chatbots feel helpful and polite, since it aligns raw capability with what people actually want.
Reference: Wikipedia: Reinforcement Learning from Human Feedback
Related terms
Reinforcement Learning
Training a model through trial and error, rewarding good outcomes and penalizing bad ones until it learns a strategy.
AI Alignment
The work of making AI systems pursue what people actually intend, including their values and safety.
Fine-Tuning
Taking a pretrained model and training it further on a smaller, focused dataset to specialize it for a task or style.
Constitutional AI
A training approach that aligns a model to an explicit written set of principles instead of relying only on human ratings.