机器学习训练集之traing 、validation、test data set

最新推荐文章于 2024-10-26 20:23:25 发布

原创最新推荐文章于 2024-10-26 20:23:25 发布 · 5.4k 阅读

1 ·

CC 4.0 BY-SA版权

文章标签：

#机器学习 #dataset #validationn #test

机器学习专栏收录该内容

37 篇文章

订阅专栏

本文介绍了监督学习的基本概念，包括所需的数据集类型及其用途。详细解释了训练、验证和测试阶段的作用，并提供了不同阶段数据比例分配的建议。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

Normally to perform supervised learning you need two types of data sets:

In one dataset (your "gold standard") you have the input data together with correct/expected output, This dataset is usually duly prepared either by humans or by collecting some data in semi-automated way. But it is important that you have the expected output for every data row here, because you need for supervised learning.
The data you are going to apply your model to. In many cases this is the data where you are interested for the output of your model and thus you don't have any "expected" output here yet.

While performing machine learning you do the following:

Training phase: you present your data from your "gold standard" and train your model, by pairing the input with expected output.
Validation/Test phase: in order to estimate how well your model has been trained (that is dependent upon the size of your data, the value you would like to predict, input etc) and to estimate model properties (mean error for numeric predictors, classification errors for classifiers, recall and precision for IR-models etc.)
Application phase: now you apply your freshly-developed model to the real-world data and get the results. Since you normally don't have any reference value in this type of data (otherwise, why would you need your model?), you can only speculate about the quality of your model output using the results of your validation phase.

The validation phase is often split into two parts:

In the first part you just look at your models and select the best performing approach using the validation data (=validation)
Then you estimate the accuracy of the selected approach (=test).

Hence the separation to 50/25/25.

In case if you don't need to choose an appropriate model from several rivaling approaches, you can just re-partition your set that you basically have only training set and test set, without performing the validation of your trained model. I personally partition them 70/30 then.