Alignment & Safety

Jailbreak

A prompt crafted to trick a model into bypassing its own safety rules and doing something it should refuse.

A jailbreak is an input designed to get around a models safety training, coaxing it to produce content it is supposed to decline, often through role-play, misdirection, or clever framing. It is the AI equivalent of social engineering, aimed at the model rather than a person. Labs study jailbreaks through red teaming and keep hardening models against them, in an ongoing back-and-forth.