Alignment & Safety
Superalignment
The research problem of keeping AI systems that are smarter than humans safe and under meaningful human control.
Superalignment looks past today models to the question of how to align systems that may eventually exceed human ability, where normal oversight breaks down because people cannot fully check the AI work. Proposed approaches include using AI to help supervise other AI and finding methods that scale beyond human-level judgment. It is a speculative but actively researched corner of safety, aimed at problems that would arrive with much more capable systems.
Related terms
AI Alignment
The work of making AI systems pursue what people actually intend, including their values and safety.
Artificial General Intelligence
A hypothetical AI that can learn and reason across any task about as well as a human, rather than being good at one narrow thing.
Interpretability
Research into understanding why a model produces the outputs it does, rather than treating it as a black box.
Red Teaming
Deliberately probing an AI system to find ways it can fail, be misused, or produce harmful output, before attackers do.