Models & Architecture
Multimodal AI
A model that can work with more than one type of input or output, such as text, images, audio, and video together.
Multimodal AI handles several kinds of data at once rather than being limited to text alone. A multimodal model can look at a photo and answer questions about it, or take a spoken prompt and reply with an image. Combining modalities tends to make models more useful and more grounded, since the information in a picture or a chart is often hard to express in words.
Reference: Wikipedia: Multimodal AI
Related terms
Large Language Model
A model trained on massive amounts of text that predicts and generates language, powering tools like ChatGPT and Claude.
Computer Vision
The field of AI that lets computers interpret images and video, from recognizing objects to reading documents.
Speech Recognition
Technology that converts spoken audio into text, the listening half of voice assistants and transcription tools.
Generative AI
AI that creates new content such as text, images, audio, or code, rather than just classifying or scoring existing data.