Training & Learning
Instruction Tuning
Fine-tuning a base model on examples of instructions and good responses so it follows requests instead of just continuing text.
A raw pretrained model only predicts the next token, so it tends to ramble or complete your prompt rather than answer it. Instruction tuning fixes that by fine-tuning on many examples of tasks phrased as instructions paired with high-quality responses, teaching the model to be a helpful assistant. It is usually the step before preference tuning like RLHF, and together they turn a base model into a usable chatbot.
Related terms
Fine-Tuning
Taking a pretrained model and training it further on a smaller, focused dataset to specialize it for a task or style.
Reinforcement Learning from Human Feedback
A training method that tunes a model to be helpful by rewarding the responses human reviewers prefer.
Pretraining
The first, largest training phase where a model learns general patterns from a huge amount of broad data.
Large Language Model
A model trained on massive amounts of text that predicts and generates language, powering tools like ChatGPT and Claude.