Stochastic Gradient Descent (SGD)

Concept and definition

Stochastic Gradient Descent (SGD)

What is Stochastic Gradient Descent (SGD)?

Stochastic Gradient Descent (SGD) is an optimisation algorithm used in training machine learning models.

The main idea behind stochastic gradient descent is to minimise a cost function by iteratively adjusting model parameters based on feedback from the training data set. Instead of updating the model parameters exhaustively with all the training data at each iteration (as in regular gradient descent), stochastic gradient descent uses small random samples of the training data (known as "minibatches" or "batches") at each iteration to update the model parameters.

Stochastic gradient descent is especially useful when the training data set is very large, as it allows the model to train more efficiently by processing small samples of the data at a time. In addition, stochastic gradient descent can help prevent the model from becoming trapped in local optima and converge more quickly to a global optimum.

Stochastic gradient descent is a widely used algorithm in the optimisation of deep learning models, and is essential for training large neural networks that require large training data sets.

« Back to glossary

Do you want to get in touch?

CDRs contain data that a telecommunications company collects about phone calls, such as time and length of call. This data can be used in analytical applications.
Fill the form
Share:
AI, a new ally for telemarketing

The acquisition of new customers is one of the most important and difficult processes for a company. Traditionally, it has been necessary to resort to [...]

Read More »
Measuring Corporate Reputation Impact: The Case of Enigmia and its AI Solution

Hoy, 3 de octubre, hemos estado en los prestigiosos "Premios SCALEUPS B2B organizada por la Fundación Empresa y Sociedad, para hablaros de la Medici [...]

Read More »
What is Data Mining?

Data Mining is a process of exploration and analysis of large amounts of data, with the objective of discovering patterns, relationships and trends that can be [...]

Read More »
Artificial Intelligence in the Fintech market

Before talking about artificial intelligence in the Fintech market, we would like to mention that the term Fintech is nowadays applied to the technologies that are [...]

Read More »
See more entries
© Gamco 2021, All Rights Reserved - Legal notice - Privacy - Cookies