Training & Learning

Backpropagation

The algorithm that figures out how to adjust each weight in a network to reduce its errors.

Backpropagation is how a neural network learns from its mistakes. After the model makes a prediction, backpropagation works backward through the layers to calculate how much each weight contributed to the error, so each one can be nudged in the right direction. Paired with gradient descent, it is the core training loop behind essentially all deep learning.

Reference: Wikipedia: Backpropagation