Models & Architecture

Foundation Model

A large, general-purpose model trained on broad data that many different applications can be built on top of.

A foundation model is trained once at great expense on a wide range of data, then adapted to countless specific uses through prompting or fine-tuning. The term captures a shift in how AI is built: instead of training a fresh model per task, teams start from one powerful base and specialize it. Large language models and large image models are the best-known examples.

Reference: Wikipedia: Foundation Model