Introduction to Markov chains, birth and death processes, and other topics.