Generative Pre-trained Transformer (GPT)

Concept and definition

Generative Pre-trained Transformer (GPT)

What is Generative Pre-trained Transformer (GPT)?

Generative Pre-trained Transformer (GPT) is a deep neural network architecture used for natural language processing (NLP) and text generation. It was developed by OpenAI and uses a machine learning technique known as "transformer", which is based on attention and parallel processing.

The most recent version of the architecture, GPT-3, is one of the largest and most advanced natural language models available, with 175 billion parameters. GPT-3 is trained on a massive text corpus to learn the structure of language and the relationship between words and sentences. Once trained, the model can be used to complete sentences, translate languages, answer questions and generate text.

GPT-3 is also capable of performing more complex tasks, such as article writing, story creation and code generation. Unlike traditional NLP models, GPT-3 does not require a specific task to be trained, but can be used for a variety of text generation tasks.

« Back to glossary

Do you want to get in touch?

CDRs contain data that a telecommunications company collects about phone calls, such as time and length of call. This data can be used in analytical applications.
Fill the form
Share:
Best Deep Learning applications and software

Deep learning translates as deep learning and is a type of artificial intelligence (AI) that is encompassed within machine learning.

Read More »
Optimal order or assortment for a customer

In the previous articles ("Basic concepts to build a commercial software with artificial intelligence" and "How to materialize the opportun [...]

Read More »
What is Data Mining?

Data Mining is a process of exploration and analysis of large amounts of data, with the objective of discovering patterns, relationships and trends that can be [...]

Read More »
Industry 4.0 and its main characteristics

Industry 4.0 or the Fourth Industrial Revolution is based on the integration of digital technologies in the production and processing of goods and services.

Read More »
See more entries
© Gamco 2021, All Rights Reserved - Legal notice - Privacy - Cookies