When you estimate a multiple regression model, you produce a coefficient vector whose quality depends critically on how distinct each regressor is from the others. If two predictors move almost in lockstep — say, GDP growth and private consumption — they each try to "explain" the same variation in your dependent variable. The OLS estimator still produces a solution, but that solution becomes exquisitely sensitive to tiny perturbations in the data.
The Variance Inflation Factor (VIF) is the scalar diagnostic that quantifies exactly this problem.
Why VIF Matters
The OLS estimator remains unbiased under multicollinearity (assuming Gauss-Markov conditions hold). This tempts many practitioners to shrug: "the estimator is still BLUE, so what's the problem?"
The answer is that unbiasedness is a property of the estimator, not of any particular estimate. Inflated variance means:
- Wide confidence intervals that render estimates practically useless
- Unstable coefficients that flip sign when you add or remove a single observation
- Non-significant t-tests even when the true effect is nonzero (Type II error inflation)
- Misleading ceteris paribus interpretations when regressors are entangled
Your model's overall F-test can be highly significant (R² near 0.95), yet every individual t-statistic is insignificant. Individual predictors seem to explain nothing — but together they explain everything. This is the classic fingerprint of severe multicollinearity. VIF is how you diagnose it.
The Formal Definition
Consider the classical linear model where is an matrix of regressors. The OLS variance-covariance matrix is:
The diagonal element for predictor gives .
Using the partitioned matrix identity, one can show:
where is the coefficient of determination from regressing on all other regressors (the auxiliary regression). If the regressors were orthogonal, and the denominator simplifies to just the total variation in .
The VIF is therefore:
Taking the square root gives the multiplicative effect on standard errors:
A VIF of 9 means your standard errors are three times larger than they would be under orthogonality. Your t-statistics are one-third as large, and your confidence intervals are three times as wide.
How VIF Is Computed: The Auxiliary Regression
For each predictor in your model, run an auxiliary OLS regression where becomes the dependent variable and all remaining predictors become the regressors. This reveals how much can be "explained away" by its siblings.
The Auxiliary Regression Engine
X₂ = α₀ + α1X₁ + α2X₃ + α3X₄ + ε
R² from auxiliary regression0.74
FORMULA
VIF(X₂) = 1 / (1 − 0.74) = 3.85
INTERPRETATION
Variance of β̂ inflated by only ×3.8 — acceptable.
The Tolerance of predictor is simply . Software packages report either or both. A tolerance close to zero (VIF → ∞) signals near-perfect linear dependency.
The Threshold Rules Explained
No universally agreed threshold exists. The literature offers several benchmarks, each grounded in a different philosophy of acceptable inference degradation.
VIF VALUE
3.00
Acceptable
R² of auxiliary reg.
0.6667
Variance inflation ×3.00
151030+
= 1
Ideal
No collinearity
1–5
Acceptable
Low inflation
5–10
Moderate
Inspect & decide
> 10
Severe
Take action
- VIF = 1 (exact): Perfect orthogonality. The sampling variance of is at its theoretical minimum. Rarely achieved in real-world data.
- : Acceptable — proceed with awareness. Mild collinearity. Variance inflation is tolerable for most applied purposes. Many macroeconomic and finance models routinely operate here.
- : Moderate — investigate and justify. Standard errors are 2.2× to 3.2× larger. You should examine condition indices and correlation matrices. Action is context-dependent.
- : Severe — action required. The conventional "red flag" threshold. Coefficient estimates are unstable and potentially sign-reversed relative to the truth.
- : Near-perfect collinearity. The matrix approaches singularity. The model is unidentified in a practical sense.
Because VIF inflates variance, its effect on standard errors (and therefore t-statistics and CIs) is the square root. VIF = 4 → SE is 2× too wide. VIF = 9 → SE is 3× too wide. Always think in terms of when interpreting practical impact on inference.
Remedies for High VIF
| Remedy | Pros | Cons | Best when… |
|---|---|---|---|
| Drop one collinear variable | Simple, immediate fix | May introduce omitted variable bias | Variables redundant by design |
| Ridge / LASSO regularisation | Retains all variables, stable estimates | Introduces bias, λ tuning required | Prediction focus, many collinear vars |
| PCA / Factor Analysis | Orthogonal components, no collinearity | Coefficients lose direct interpretability | Dimensionality reduction acceptable |
| Collect more data | Reduces SE, may dissolve collinearity | Not always feasible | Small samples with few degrees of freedom |
| Mean-center / standardise | Removes NCS (non-essential) collinearity | Does not fix essential collinearity | Interaction terms, polynomial models |
| Structural / theory constraint | Economically grounded | Requires strong prior | IRRBB, pass-through, macro models |
First ask: Is the collinearity essential or incidental? Essential collinearity (variables are theoretically inseparable) means you should not try to separate their effects — constrain or combine them via theory. Incidental collinearity (driven by sample, not structure) is fair game for ridge regression, PCA, or collecting more data.
Key Takeaways
- VIF measures variance inflation relative to an orthogonal benchmark: .
- OLS remains unbiased under collinearity, but inflated variances destroy inference reliability — wide CIs, non-significant t-tests, unstable coefficients.
- Practical thresholds: acceptable, 5–10 investigate, act. Context matters — finance and macro models with structurally linked variables often warrant more tolerance.
- The gives the multiplicative factor applied to standard errors. Communicate in SEs, not raw variances.
- Remedies range from dropping variables (risky) to regularisation (ridge, LASSO) to structural constraints grounded in theory.
- In time-varying frameworks, monitor VIF dynamically — rising VIF can signal that pass-through effects or other relationships are becoming statistically entangled.
VIF · Variance Inflation Factor · Multicollinearity Diagnostics
"A statistic that knows when your model is lying about certainty."