Discrete Stochastic Processes
Course Notes
This section contains a draft of the class notes as provided to the students in Spring 2011. An updated and improved version of the draft notes can be found here. However, the problem sets refer to the problems as they are numbered in the OCW notes.
|
CHAPTERS |
FILES |
|
Front matter: Preface, table of contents |
(PDF) |
|
Chapter 1: Introduction and review of probability |
|
|
Chapter 2: Poisson processes |
(PDF) |
|
Chapter 3: Finite-state Markov chains |
|
|
Chapter 4: Renewal processes |
|
|
Chapter 5: Countable-state Markov chains |
(PDF) |
|
Chapter 6: Markov processes with countable state spaces |
|
|
Chapter 7: Random walks, large deviations, and martingales |
|
|
Back matter: Appendix, bibliography |
(PDF) |
Assignments
|
ASSN # |
PROBLEM SETS |
SOLUTIONS |
|
1 |
(PDF) |
(PDF) |
|
2 |
(PDF) |
(PDF) |
|
3 |
(PDF) |
(PDF) |
|
4 |
(PDF) |
(PDF) |
|
5 |
(PDF) |
(PDF) |
|
6 |
(PDF) |
(PDF) |
|
7 |
(PDF) |
(PDF) |
|
8 |
(PDF) |
(PDF) |
|
9 |
(PDF) |
(PDF) |
|
10 |
(PDF) |
(PDF) |
|
11 |
(PDF) |
(PDF) |
|
12 |
(PDF) |
(PDF) |
Exams
Midterm Exams
|
EXAMS |
SOLUTIONS |
|
2011 midterm (PDF) |
(PDF) |
|
2010 midterm (PDF) |
(PDF) |
|
2009 midterm (PDF) |
(PDF) |
Final Exams
|
EXAMS |
SOLUTIONS |
|
2011 final (PDF) |
(PDF) |
|
2009 final (PDF) |
(PDF) |