Alignment & Safety

AI Alignment

The work of making AI systems pursue what people actually intend, including their values and safety.

Alignment is the effort to ensure an AI does what its designers and users really want, not just the literal objective it was given, which can diverge in surprising ways. It spans everyday concerns like keeping a chatbot helpful and honest, and long-horizon concerns about keeping powerful future systems under meaningful human control. Techniques like RLHF and constitutional AI are practical attempts at alignment.

Reference: Wikipedia: AI Alignment