RLHF
[/ɑːr el eɪtʃ ef/]
Definitions
Reinforcement Learning from Human Feedback — a training technique used to align language models with human preferences. Human raters compare model outputs and choose the better response; these preferences train a reward model which then guides further fine-tuning via reinforcement learning.
“RLHF is the key step that turns a raw language model into a helpful, harmless assistant.”
Related Terms
- Constitutional AIAI & Technology
A training methodology developed by Anthropic where a set of guiding principles (a "constitution") is used to self-supervise and refine AI outputs. The model critiques and rewrites...
- Fine-TuningAI & Technology
The process of further training a pre-trained model on a smaller, task-specific dataset to adapt its behavior for a particular domain or style. Fine-tuning updates the model's weig...
- Synthetic DataAI & Technology
Artificially generated data that mimics the statistical properties of real-world data, used for training or testing AI models. Synthetic data can be created by generative models, r...
- AgenticAI & Technology
Describing AI systems capable of autonomous action, planning, and decision-making. An agentic AI can break down tasks, use tools, and work toward goals with minimal human intervent...
- AI AlignmentAI & Technology
The research field focused on ensuring that AI systems pursue goals that match human values and intentions. A misaligned AI might optimize for a metric that appears correct but pro...
- Chain of ThoughtAI & Technology
A prompting technique where a language model is encouraged or required to show its step-by-step reasoning before providing a final answer. Chain-of-thought prompting significantly ...