Gradient descent

Concept and definition

Gradient descent

What is Gradient descent?

Gradient descent is an optimisation algorithm used in machine learning and deep learning to adjust the parameters of a model to minimise the cost or loss function.

The goal of gradient descent is to find the values of the model parameters that minimise the cost function, i.e. those that produce the most accurate predictions. To do this, the algorithm uses the information provided by the gradient of the cost function at each iteration of the training process.

At each iteration, the gradient descent adjusts the values of the model parameters in the opposite direction to the gradient of the cost function, in order to decrease the prediction error. The learning rate is a hyperparameter of the algorithm that determines the step size at each iteration, and can be adjusted to obtain a trade-off between convergence speed and accuracy of the result.

Gradient descent is used in various machine learning and deep learning algorithms, such as linear regression, logistic regression, neural networks, among others.

« Back to glossary

Do you want to get in touch?

CDRs contain data that a telecommunications company collects about phone calls, such as time and length of call. This data can be used in analytical applications.
Fill the form
Share:
Qualified lead generation for new customer acquisition using AI

Today we are going to talk about the generation of qualified leads for the acquisition of new customers through AI. At Gamco, we develop software based on [...]

Read More »
Measuring Corporate Reputation Impact: The Case of Enigmia and its AI Solution

Hoy, 3 de octubre, hemos estado en los prestigiosos "Premios SCALEUPS B2B organizada por la Fundación Empresa y Sociedad, para hablaros de la Medici [...]

Read More »
Artificial Intelligence in the Fintech market

Before talking about artificial intelligence in the Fintech market, we would like to mention that the term Fintech is nowadays applied to the technologies that are [...]

Read More »
What is artificial intelligence?

Before explaining what artificial intelligence is, we would like to start with a sentence from the book Age of intelligent machines (1992), by Raymond Ku [...]

Read More »
See more entries
© Gamco 2021, All Rights Reserved - Legal notice - Privacy - Cookies