Lecture Notes
- Lec1 : Introduction (slides)
- Lec2,3: Learning Challenge and first look at Generalization (Slides) (Notes)
- Related topics Hoffeding Inequality Markov Inequality Union Bound
- TA Ses1 (13 Feb, 4-5 P.M.): Prove of Hoffeding Inequality Wikipedia
- Lec3,4: Bayes Classifier and Nearest Neighbour (slides) (Notes)
- Lec4,5: Naive Bayes and LDA (Slides) (Notes)
- Lec6,8: LDA and Logistic Regression (slides)(Notes)
- Lec5,6: Gradient Descent (Notes)
- Lec7: Newton’s Method (Notes)
- Lec8,9: Beyond plug-in methods (Slides)
- Lec9,10: Kernal Methods (Notes) (Slides)
- Week 6 from edx.org course
- Lec10,11,12: Support Vector Machines (Notes) (Slides)
- Lec13,14: Theory of Generalization 1 (Notes) (Slides)
- Lec15,16: Theory of Generalization 2 (Notes) (Slides)
Mid terms
Instructions for midterm is on piazza