gradient_descent
Differences
This shows you the differences between two versions of the page.
| Both sides previous revisionPrevious revisionNext revision | Previous revision | ||
| gradient_descent [2025/08/21 16:17] – [How to unnormalize (unscale) a and b] hkimscil | gradient_descent [2025/10/02 11:59] (current) – hkimscil | ||
|---|---|---|---|
| Line 1: | Line 1: | ||
| ====== Gradient Descent ====== | ====== Gradient Descent ====== | ||
| - | ====== explanation ====== | ||
| - | |||
| ====== R code: Idea ====== | ====== R code: Idea ====== | ||
| < | < | ||
| + | library(tidyverse) | ||
| + | library(data.table) | ||
| library(ggplot2) | library(ggplot2) | ||
| library(ggpmisc) | library(ggpmisc) | ||
| Line 541: | Line 540: | ||
| & = & -2 X_i \sum{(Y_i - (a + bX_i))} \\ | & = & -2 X_i \sum{(Y_i - (a + bX_i))} \\ | ||
| & = & -2 * X_i * \sum{\text{residual}} \\ | & = & -2 * X_i * \sum{\text{residual}} \\ | ||
| - | \\ | + | & .. & -2 * X_i * \frac{\sum{\text{residual}}}{n} \\ |
| + | & = & -2 * \overline{X_i * \text{residual}} \\ | ||
| \end{eqnarray*} | \end{eqnarray*} | ||
gradient_descent.1755760669.txt.gz · Last modified: by hkimscil