I am trying to prep myself for data science interview & I saw the following question on a forum
In the case of least square regression, how does the variance of the error term change with the number of predictors?
I am not sure how to answer this? Any ideas?
Any help will be appreciated
Contents
hide
Best Answer
The variance of the error term decreases (or, at worst, does not increase) when you add more regressors. The reason is that a new variable can explain some more variability in the data that wasn't explained by previous regressors. This will reduce the unexplained variations in the data, whch will cause the variance of the error term to decrease.
Similar Posts:
- Solved – from where the error in target variable comes in linear regression
- Solved – Why is $E[u] = 0$ in OLS and what is the difference between the error and constant
- Solved – Adding Regressors: How Does the Estimated Variance of the Error Terms Change
- Solved – Translation of the term “data science” into Russian
- Solved – Regressors with low variance