It is the closed-form solution for optimal parameters in a linear model, obtained by minimizing the Squared Error Function.
Components
- = optimal weight/parameter vector
- = design matrix where
- Each row = one data point
- Each column = one basis function evaluated at all points
- = target vector (all training outputs)