Course Outline

  1. Brief Introduction - deterministic vs. stochastic models
  2. Review of important concepts in probability theory
  3. What is a stochastic process; classification and examples
  4. Finite Markov Chains (discrete time)
  5. Countable Markov chains; random walks (discrete time)
  6. Continuous time Markov chains (CTMC); Poisson process; birth-death process
  7. diffusion processes
  8. Brownian motion
  9. stochastic differential equations; connection to diffusion processes
  10. first passage times; applications
  11. more topics to be added

Last Modified: Wednesday, 17-Aug-2005 13:26:21 CDT by Charles Tier