Training & Learning

Overfitting

When a model memorizes its training data too closely and then performs badly on anything new.

Overfitting happens when a model learns the quirks and noise of its training set instead of the general pattern, so it looks excellent on familiar data and fails on fresh data. It is one of the most common ways machine learning projects go wrong. The usual defenses are more and more varied data, simpler models, and techniques that discourage the model from leaning too hard on any single detail.

Reference: Wikipedia: Overfitting