Training & Learning

Optimizer

The algorithm that decides how to adjust a model weights from its errors, with Adam being the common default.

An optimizer takes the error signal from backpropagation and turns it into actual weight updates, deciding the direction and size of each step. Plain gradient descent is the baseline, while adaptive methods like Adam adjust the step for each weight automatically and converge faster, which is why Adam is the default for most deep learning. The choice of optimizer and its settings meaningfully affects how well and how quickly a model trains.