Generative Pre-trained Transformer (GPT)

Concept and definition

Generative Pre-trained Transformer (GPT)

What is Generative Pre-trained Transformer (GPT)?

Generative Pre-trained Transformer (GPT) is a deep neural network architecture used for natural language processing (NLP) and text generation. It was developed by OpenAI and uses a machine learning technique known as "transformer", which is based on attention and parallel processing.

The most recent version of the architecture, GPT-3, is one of the largest and most advanced natural language models available, with 175 billion parameters. GPT-3 is trained on a massive text corpus to learn the structure of language and the relationship between words and sentences. Once trained, the model can be used to complete sentences, translate languages, answer questions and generate text.

GPT-3 is also capable of performing more complex tasks, such as article writing, story creation and code generation. Unlike traditional NLP models, GPT-3 does not require a specific task to be trained, but can be used for a variety of text generation tasks.

« Back to glossary

Do you want to get in touch?

CDRs contain data that a telecommunications company collects about phone calls, such as time and length of call. This data can be used in analytical applications.
Fill the form
Share:
Types of artificial intelligence according to their capabilities and functionality 

Unlike a computer program, in which a list of commands are processed through a computer program, AI goes beyond the [...]

Read More »
Automation and rapid deployments via SaaS

One of the decisions faced by a company that needs an IT infrastructure is the choice of where to locate this infrastructure and where to install it.

Read More »
The best fraud detection software

Fraud detection software is an important tool for protecting companies and individuals from fraudulent activity and minimizing the risk of fraud.

Read More »
Abbreviated History of Artificial Intelligence

The content of this article synthesizes part of the chapter "Concept and brief history of Artificial Intelligence" of the thesis Generation of Artificial [...]

Read More »
See more entries
© Gamco 2021, All Rights Reserved - Legal notice - Privacy - Cookies