Models & Architecture

Parameters

The adjustable numbers inside a model that get tuned during training and store what the model has learned.

Parameters are the internal values, mostly the connection weights, that a model adjusts as it trains. A models size is usually quoted as its parameter count, from millions to hundreds of billions, because more parameters generally mean more capacity to capture patterns. Parameter count is a rough proxy for capability, but it is not the whole story, since data quality and training method matter just as much.