Infrastructure

CUDA

The software platform from NVIDIA that lets general code run on its GPUs, and a big reason NVIDIA dominates AI hardware.

CUDA is the programming layer that lets developers harness the thousands of parallel cores in an NVIDIA GPU for general computation, including the math behind neural networks. Because nearly all major AI frameworks are built on it, CUDA has become a deep moat: it ties the ecosystem to NVIDIA hardware and is a large part of why the company leads the AI chip market. It is the bridge between AI software and the GPU underneath.

Reference: Wikipedia: CUDA