Sep 9 Sep 13

Lecture 1,2

Introduction and Basic Concepts. Linear Algebra and Multivariable Calculus review.

Reading:
Notes on Linear Algebra.
Lecture 1 Slides.

Before the Lecture:
Recommended: Review background materials on Linear Algebra and Multivariable Calculus.

During Lecture:
Synchronous: Overview of machine learning and the course.
Asynchronous: Review of linear algebra and multivariable calculus.

Sep 16 Sep 20

Lecture 3,4

Supervised Learning Setup. Linear Regression. Basic probability theory review.

Reading:
Notes on Basic Probability
Sections 1-3 of the notes on Supervised Learning Setup & Linear Regression.

Before the Lecture:
Recommended: Review background materials on Basic Probability.

During Lecture:
Synchronous: Supervised Learning Setup. Linear Regression.
Asynchronous: Basic probability theory review.

Sep 17

Assignment 1

Assignment 1 will be posted online.

Sep 23 Sep 27

Lecture 5,6

Weighted Least Squares. Logistic Regression. Newton's Method. Exponential Family. Generalized Linear Models. Python overview.

Reading:
Sections 4-9 of the notes on Regression.

Before the Lecture:
Recommended: Review background materials on Python.

During Lecture:
Synchronous: Weighted Least Squares. Logistic Regression. Newton's Method.
Asynchronous: Exponential Family. Generalized Linear Models. Python overview.

Oct 1

Project Proposal

Project proposal due at midnight (i.e., 11:59 PM or 23:59) eastern time.

Sep 30 Oct 4

Lecture 7,8

Evaluation Metrics. Gaussian Discriminant Analysis. Naive Bayes.

Reading:
Sections 1-2 of the notes on Generative Models.

Before the Lecture:
Recommended: Review class notes.

During Lecture:
Synchronous: Gaussian Discriminant Analysis. Naive Bayes.
Asynchronous: Evaluation Metrics.

Oct 11

Assignment 1

Assignment 1 due at midnight (i.e., 11:59 PM or 23:59) eastern time.

Oct 7 Oct 18

Lecture 9,10

Laplace Smoothing. Support Vector Machines.

Reading:
Sections 2 of the notes on Generative Models.
Sections 1-5, 7 of the notes on Kernels and SVM.

Before the Lecture:
Recommended: Review class notes.

During Lecture:
Synchronous: Laplace Smoothing. Support Vector Machines.
Asynchronous: Support Vector Machines.

Oct 18

Assignment 2

Assignment 2 will be posted online.

Oct 21 Oct 25

Lecture 11,12

Neural Networks, forward and backpropagation. Improving NNs.

Reading:
Notes on Deep Learning and Backpropagation.

Before the Lecture:
Recommended: Review class notes.

During Lecture:
Synchronous: Neural Networks, forward and backpropagation.
Asynchronous: Improving NNs.

Oct 28 Nov 1

Lecture 13,14

Deep learning, CNNs, RNNs, and beyond. Practical advice for your project.

Reading:
Lecture notes and slides will be posted after the lecture.

Before the Lecture:
Recommended: Have a very good sense of your progress in the project and challenges you are currently facing. You should be about halfway through your project.

During Lecture:
Synchronous: Practical advice for your project.
Asynchronous: Deep learning, CNNs, RNNs, and beyond.

Nov 8

Assignment 2

Assignment 2 due at midnight (i.e., 11:59 PM or 23:59) eastern time.

Nov 4 Nov 8

Lecture 15,16

Regularization. Feature/Model selection. K-Means. GMM.

Reading:
Notes on Regularization. Feature/Model selection.
Notes on k-means.
Notes on GMM.

Before the Lecture:
Recommended: Review class notes.

During Lecture:
Synchronous: K-Means. GMM.
Asynchronous: Regularization. Feature/Model selection.

Nov 9

Assignment 3

Assignment 3 will be posted online.

Nov 11 Nov 15

Lecture 17,18

Decision Trees. Boosting. Bagging. Principal and Independent Component Analysis.

Reading:
Notes on Principal Component Analysis.
Notes on Independent Component Analysis.

Before the Lecture:
Recommended: Review class notes.

During Lecture:
Synchronous: Principal and Independent Component Analysis.
Asynchronous: Decision Trees. Boosting. Bagging.

Nov 18 Nov 22

Lecture 19,20

Weak supervision. Critiques of Machine Learning.

Reading:
Notes on Weak Supervision.

Before the Lecture:
Recommended: Review class notes.

During Lecture:
Synchronous: Weak supervision.
Asynchronous: Critiques of Machine Learning.

Nov 25 Nov 29

Lecture 21,22

Reinforcement learning. Value Iteration and Policy Iteration. Bias Variance trade-off.

Reading:
Notes on Reinforcement learning.
Notes on Bias Variance trade-off.

Before the Lecture:
Recommended: Review class notes.

During Lecture:
Synchronous: Reinforcement learning. Value Iteration and Policy Iteration.
Asynchronous: Bias Variance trade-off.

Dec 1

Assignment 3

Assignment 3 due at midnight (i.e., 11:59 PM or 23:59) eastern time.

Dec 2 Dec 6

Lecture 23,24

Course Review and Guest Lectures.

During Lecture:
Synchronous: Guest lectures.

Dec 12

Final Project

Final Project due at midnight (i.e., 11:59 PM or 23:59) eastern time.