用线性回归计算缺失值

• Missing data

  Missing data can grocely be classified into three types:

  1. MCAR(Missing Completely At Random), which means that there is nothing systematic about why some date is missing. That is, there is no relationship between the fact that data is missing and either the observed or unobserved covariates.
  2. MAR(Missing At Random), resembles MCAR because there still is an element of randomness.
  3. MNAR(Missing Not At Random), implies that the fact that fata is missing is directly correlated with the value of the misssing data.

• How to deal with missing data

  1. Just delete missing entries

  2. Replaceing missing values with the mean or median

  3. Linear Regression

     First, several predictors of the variable with missing values are identified using a correlation matrix. The best predictors are selected and used as independent variables in a regression equation.

     The variable with missing data is used as the dependent variable.

     Second, cases with complete data for the predictor variables are used to generate the regression equation;

     Third, the equation is then used to predict missing values for incomplete cases in an iterative process.

     以上是单变量线性回归

  4. 多元线性回归

     Linear regression has signigicant limits like:

     • It can’t easily match any data set that is non-linear
     • It can only be used to make predictions that fit within the range of the training data set
     • It can only be fit to data sets with a single dependent variables and a single independent variable

     This is where multiple regression comes in. It is specifically designed to create regressions on models with a single dependent variable and multiple independent variables.

     Equation for multiple regpression takes the form:
     $$y=$$