Generative Pre-trained Transformer (GPT)

Concept and definition

Generative Pre-trained Transformer (GPT)

What is Generative Pre-trained Transformer (GPT)?

Generative Pre-trained Transformer (GPT) is a deep neural network architecture used for natural language processing (NLP) and text generation. It was developed by OpenAI and uses a machine learning technique known as "transformer", which is based on attention and parallel processing.

The most recent version of the architecture, GPT-3, is one of the largest and most advanced natural language models available, with 175 billion parameters. GPT-3 is trained on a massive text corpus to learn the structure of language and the relationship between words and sentences. Once trained, the model can be used to complete sentences, translate languages, answer questions and generate text.

GPT-3 is also capable of performing more complex tasks, such as article writing, story creation and code generation. Unlike traditional NLP models, GPT-3 does not require a specific task to be trained, but can be used for a variety of text generation tasks.

« Back to glossary

Do you want to get in touch?

CDRs contain data that a telecommunications company collects about phone calls, such as time and length of call. This data can be used in analytical applications.
Fill the form
Share:
What credit scoring is and why Artificial Intelligence will change it forever

Credit scoring is a system used to rate credits and thus try to automate the decision making process at the time of purchasing a loan, and to [...]

Read More »
Business opportunity and artificial intelligence

Companies are becoming increasingly aware of the importance of gradually incorporating artificial intelligence into their business models. The imp [...]

Read More »
ERP vs CRM system: What is the difference?

If you don't know the difference between an ERP (Enterprise Resource Planning) system and a CRM (Customer Relationship Management) system, here's what you need to know about the [...]

Read More »
What is Surety Insurance?

You are probably wondering, what is surety insurance and how does it help your company? In today's economic environment, [...]

Read More »
See more entries
© Gamco 2021, All Rights Reserved - Legal notice - Privacy - Cookies