Validation Set

What Does Validation Set Mean?

In machine learning, a validation set is used to “tune the parameters” of a classifier. The validation test evaluates the program’s capability according to the variation of parameters to see how it might function in successive testing.


The validation set is also known as a validation data set, development set or dev set.

Techopedia Explains Validation Set

Ideally, the program will have three data sets: a training set, a validation set and a test set. In the first step, the training, the program is using training data to learn and build a model. In the second phase, the validation helps to deal with issues like overfitting, where the program may not be calibrated well to handle future data. In terms of the complex equations that result from training and test iterations, engineers talk about “local minima and maxima,” which denote segments of the output process that can help the engineers decide where to “end” a phase. In the third stage, the test stage, new test data is brought in to see if the machine performs as well and accurately on test data as it did on training data, or whether a wide gulf between performance on the two stages indicates overfitting has occurred.


Related Terms

Latest Artificial Intelligence Terms

Related Reading

Margaret Rouse

Margaret Rouse is an award-winning technical writer and teacher known for her ability to explain complex technical subjects to a non-technical, business audience. Over the past twenty years her explanations have appeared on TechTarget websites and she's been cited as an authority in articles by the New York Times, Time Magazine, USA Today, ZDNet, PC Magazine and Discovery Magazine.Margaret's idea of a fun day is helping IT and business professionals learn to speak each other’s highly specialized languages. If you have a suggestion for a new definition or how to improve a technical explanation, please email Margaret or contact her…