Training & Learning

Batch Size

How many training examples the model looks at before it updates its weights once.

Batch size sets how many examples are processed together before the model makes one update. Larger batches give smoother, more stable updates and use hardware more efficiently but need more memory, while smaller batches add useful noise and fit on smaller machines. It interacts closely with the learning rate, so the two are usually tuned together.