Infrastructure

Floating-Point Operations Per Second

FLOPS

A measure of raw computing speed used to size AI hardware and training runs.

FLOPS, floating-point operations per second, quantifies how much calculation hardware can do, and total operations is also used to describe how much computation a training run consumed. Training a frontier model can take on the order of ten to the twenty-fifth operations or more, which is why it needs massive GPU clusters. The figure is a common currency for comparing chips and for policy proposals that would regulate models above a compute threshold.

Reference: Wikipedia: Floating-Point Operations Per Second