It is the closed-form solution for optimal parameters in a linear model, obtained by minimizing the Squared Error Function.

Components

  • = optimal weight/parameter vector
  • = design matrix where
    • Each row = one data point
    • Each column = one basis function evaluated at all points
  • = target vector (all training outputs)