Differences

This shows you the differences between two versions of the page.

--- multicollinearity [2023/05/17 12:05] – [using VIF (Variance Inflation Factors)] hkimscil
+++ multicollinearity [2023/05/22 07:57] (current) – [Testing with correlation matrix] hkimscil
@@ Line 7: / Line 7: @@
 see [[:Singularity]] \\
-====== Testing with correlation matrix ======
+====== Testing multicollinearity with correlation matrix ======
 <code>
 options(digits = 4)
@@ Line 68: / Line 68: @@
 F-statistic:   26 on 1 and 8 DF,  p-value: 0.00093
-> 1 - summary(m.tolerance)$r.squared
+> tol <- 1 - summary(m.tolerance)$r.squared
+> tol
 [1] 0.2352
 </code>
+====== using VIF (Variance Inflation Factors) ======
+Variance Inflation Factor 는 독립변인의 계수값에 인플레이션이 있는지 확인해 보는 방법으로 VIF = 1 인 경우, 해당 독립변인이 다른 변인들에 의해 영향을 받지 않았다는 것을 의미한다. 아래처럼 구한다. 일반적으로 VIF 값이 5 이상이면 주목하여 살펴본다. 10 이상이면 multicollinearity를 의미한다고 한다.
+<code>
+tol <- 1- summary(m.tolerance)$r.squared
+tol
+m.vif <- 1/tol
+m.vif
+</code>
+<code>
+> tol <- 1- summary(m.tolerance)$r.squared
+> tol
+[1] 0.2352
+> m.vif <- 1/tol
+> m.vif
+[1] 4.251
+>
+</code>
+R 에서는
+<code>
+m.a <- lm(FGPA ~ SATV+HSGPA, data = scholar)
+summary(m.a)
+# install.packages("olsrr")
+# library(olsrr)
+ols_vif_tol(m.a)
+</code>
+<code>
+> m.a <- lm(FGPA ~ SATV+HSGPA, data = scholar)
+> summary(m.a)
+Call:
+lm(formula = FGPA ~ SATV + HSGPA, data = scholar)
+Residuals:
+    Min      1Q  Median      3Q     Max
+-0.2431 -0.1125 -0.0286  0.1269  0.2716
+Coefficients:
+            Estimate Std. Error t value Pr(>|t|)
+(Intercept) 0.233102   0.456379    0.51    0.625
+SATV        0.000151   0.001405    0.11    0.917
+HSGPA       0.845192   0.283816    2.98    0.021 *
+---
+Signif. codes:
+‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1
+Residual standard error: 0.192 on 7 degrees of freedom
+Multiple R-squared:  0.851,	Adjusted R-squared:  0.809
+F-statistic: 20.1 on 2 and 7 DF,  p-value: 0.00126
+> # install.packages("olsrr")
+> # library(olsrr)
+> ols_vif_tol(m.a)
+  Variables Tolerance   VIF
+      SATV    0.2352 4.251
+     HSGPA    0.2352 4.251
+>
+</code>
+====== using condition index ======
+<code>
+ols_eigen_cindex(m.a)
+</code>
+<code>
+> ols_eigen_cindex(m.a)
+  Eigenvalue Condition Index intercept      SATV     HSGPA
+   2.983908            1.00  0.001961 0.0006461 0.0004659
+   0.013568           14.83  0.837019 0.1204555 0.0222304
+   0.002524           34.38  0.161020 0.8788984 0.9773037
+>
+</code>
 {{tag>multicollinearity singularity regression preassumption statistics }}