Models & Architecture
Large Language Model
LLMA model trained on massive amounts of text that predicts and generates language, powering tools like ChatGPT and Claude.
A large language model learns the statistical patterns of language by training on enormous text collections, then generates new text one token at a time by repeatedly predicting what comes next. That simple mechanism, scaled up to billions of parameters, turns out to produce writing, reasoning, translation, and code. LLMs are the foundation of modern chatbots and most generative AI products.
Reference: Wikipedia: Large Language Model
Related terms
Transformer
The neural network design behind almost every modern language model, built around a mechanism called attention.
Token
The small chunk of text a language model actually reads and writes, usually a word or part of a word.
Foundation Model
A large, general-purpose model trained on broad data that many different applications can be built on top of.
Generative AI
AI that creates new content such as text, images, audio, or code, rather than just classifying or scoring existing data.