Machine Learning

1. Introduction:

• Deduction, Abduction & Induction
• Probability Formulae
• Types of Machine Learning

2. Supervised Learning - Regression

• Regression
• Empirical Error (Parameter Optimization)
• Regularisation
• Perceptron in Mathematical Notation

3. Probabilitstic Modelling

• Aleatoric vs Epistemic Uncertainty
• Using Likelihood to Model Probability
• Bayesian Inference
• Maximum a-posteriori estimation for a Gaussian distributed data model using regularization.

4. Incremental Bayesian Learning

• Incremental Bayesian Learning

5. Error Minimization

• Generalized Learning Rule
• Finding Hyper Parameter
• Cross Validation
• Bias vs Variance
• Double Descent

6. Local and Unified Models

7. Definition of Decision Boundary

• Decision Boundary and Hyperplane
• Three approaches to classification
  • Discriminant Function (Fisher LDF as Example)
  • Bayesian Modeling
  • Direct Posterior Modeling