Training & Learning

Hyperparameter

A setting you choose before training that controls how the model learns, as opposed to what it learns.

Hyperparameters are the knobs set by the people building a model rather than learned from data, things like the learning rate, the number of layers, or how long to train. They are distinct from parameters, which the model learns on its own. Tuning hyperparameters well can be the difference between a model that works and one that does not, and much of the hands-on craft of training lives here.

Reference: Wikipedia: Hyperparameter