Validation set

Concept and definition

Validation set

What is Validation set?

The validation set in the context of artificial intelligence and machine learning, refers to an independent dataset used to evaluate the ability of a trained model to generalise to previously unseen data.

Unlike the test set, the new or validation set is not used to tune the hyperparameters of the model, but is used to evaluate its final performance after the optimal hyperparameters have been selected. Therefore, the new or validation set is used to avoid over-fitting the test data and to obtain a more realistic assessment of the model's ability to generalise.

The new or validation set is used to select between alternative models and to tune the final model parameters prior to production deployment. The choice of the new or validation set and its appropriate size are critical to the model evaluation, as it must represent the data that the model will encounter in production.

Importantly, the new or validation set must also be independent of the training set and test set to ensure that the model has not previously seen the validation data during its training or pre-evaluation.

« Back to glossary

Do you want to get in touch?

CDRs contain data that a telecommunications company collects about phone calls, such as time and length of call. This data can be used in analytical applications.
Fill the form
How Artificial Intelligence is revolutionizing the retail sector

Artificial intelligence (AI), Machine Learning (ML) and data analytics are rapidly changing and having a major impact on our business.

Read More »
Qualified lead generation for new customer acquisition using AI

Today we are going to talk about the generation of qualified leads for the acquisition of new customers through AI. At Gamco, we develop software based on [...]

Read More »
Artificial Intelligence Regulatory Compliance

AI technologies are currently being used in companies to transform business processes, boost customer interaction and improve customer service.

Read More »
What is GAMCO and why should I use it for my business?

GAMCO is a pioneer in the creation of Artificial Intelligence and Machine Learning software solutions. GAMCO's solutions are designed to [....]

Read More »
See more entries
© Gamco 2021, All Rights Reserved - Legal notice - Privacy - Cookies