Generative Pre-trained Transformer (GPT)

Concept and definition

Generative Pre-trained Transformer (GPT)

What is Generative Pre-trained Transformer (GPT)?

Generative Pre-trained Transformer (GPT) is a deep neural network architecture used for natural language processing (NLP) and text generation. It was developed by OpenAI and uses a machine learning technique known as "transformer", which is based on attention and parallel processing.

The most recent version of the architecture, GPT-3, is one of the largest and most advanced natural language models available, with 175 billion parameters. GPT-3 is trained on a massive text corpus to learn the structure of language and the relationship between words and sentences. Once trained, the model can be used to complete sentences, translate languages, answer questions and generate text.

GPT-3 is also capable of performing more complex tasks, such as article writing, story creation and code generation. Unlike traditional NLP models, GPT-3 does not require a specific task to be trained, but can be used for a variety of text generation tasks.

« Back to glossary

Do you want to get in touch?

CDRs contain data that a telecommunications company collects about phone calls, such as time and length of call. This data can be used in analytical applications.
Fill the form
Share:
How does semantic technology work?�

To know how semantic technology works, the first thing you need to know is that it is responsible for helping artificial intelligence systems [...]

Read More »
Retail Future, a look at the future of Retail, where Artificial Intelligence could not be missing.

A few days ago we were able to attend a pioneering event in the world of Retail, the Retail Future 2022 fair. In its fifth edition, and under the slogan "Challenge [...]

Read More »
Artificial intelligence applied to the semantic web 

The semantic web or "internet of knowledge" is an extension of the current web. Unlike the latter, the semantic web is based on proportional [...]

Read More »
Artificial intelligence against delinquency and non-payments in companies

The current scenario we are experiencing in Spain with the COVID-19 health crisis has led to many companies having to carry out ER [...]

Read More »
See more entries
© Gamco 2021, All Rights Reserved - Legal notice - Privacy - Cookies