1

Introduction, linear classification, perceptron update rule (PDF)

2

Perceptron convergence, generalization (PDF)

3

Maximum margin classification (PDF)

4

Classification errors, regularization, logistic regression (PDF)

5

Linear regression, estimator bias and variance, active learning (PDF)

6

Active learning (cont.), non-linear predictions, kernals (PDF)

7

Kernal regression, kernels (PDF)

8

Support vector machine (SVM) and kernels, kernel optimization (PDF)

9

Model selection (PDF)

10

Model selection criteria (PDF)

11

Description length, feature selection (PDF)

12

Combining classifiers, boosting (PDF)

13

Boosting, margin, and complexity (PDF)

14

Margin and generalization, mixture models (PDF)

15

Mixtures and the expectation maximization (EM) algorithm (PDF)

16

EM, regularization, clustering (PDF)

17

Clustering (PDF)

18

Spectral clustering, Markov models (PDF)

19

Hidden Markov models (HMMs) (PDF)

20

HMMs (cont.) (PDF)

21

Bayesian networks (PDF)

22

Learning Bayesian networks (PDF)

23

Probabilistic inference

Guest lecture on collaborative filtering (PDF)

24

Current problems in machine learning, wrap up

Problem set 1 (PDF)

Section A (PDF)

Section B (PDF)

perceptron_test.m (M)

perceptron_train.m (M)

Errata (TXT)

p1.zip (ZIP) (The ZIP file contains: 3 .m files and 4 .dat files.)

p3.zip (ZIP - 8.5 MB) (The ZIP file contains: 3 .svm files.)

strimage.m (M)

Problem set 2 (PDF)

(PDF)

Errata (TXT)

Problem set 3 (PDF)

(PDF)

Errata (TXT)

Problem set 4 (PDF)

(PDF)

Errata (TXT)

Problem set 5 (PDF)

(PDF)

Errata (TXT)

Prob1 data (ZIP) (The ZIP file contains: 12 .m files, 1 .de file.)

Prob2 data (ZIP) (The ZIP file contains: 10 .m files and 2 .dat files.)

Midterms

Fall 2006

(PDF)

Fall 2004 (PDF)

(PDF)

Fall 2003 (PDF)

(PDF)

Fall 2002 (PDF)

(PDF)

Fall 2001 (PDF)

(PDF)

Finals

Fall 2004 (PDF)

(PDF)

Fall 2003 (PDF)

(PDF)

Fall 2002 (PDF)

(PDF)

Fall 2001 (PDF)

(PDF)