AI glossary Models & Architecture
What is GPT?
GPT (Generative Pre-trained Transformer)
← All glossary termsArchitecture behind language models like ChatGPT.
Explained
GPT is an architecture for autoregressive language models. Models are pre-trained on huge text corpora and can generate coherent text. ChatGPT, GPT-4, and many alternatives are based on this paradigm.