Prompting & Inference
System Prompt
A behind-the-scenes instruction that sets a model’s role, rules, and tone for an entire conversation.
A system prompt is a special instruction given to a model before the user starts talking, used to define its persona, boundaries, and standing rules. It is how a product makes a general model behave like a specific assistant, such as a support agent that only discusses its own company. Users usually never see it, but it quietly governs how the model responds throughout the exchange.
Related terms
Prompt
The input you give a generative model, usually instructions or a question, that tells it what you want.
Prompt Engineering
The practice of wording and structuring prompts to get better, more reliable results from a model.
Guardrails
Controls placed around a model to keep its inputs and outputs safe, on-topic, and within policy.
Chatbot
A program you interact with through conversation, now usually powered by a large language model.