**Course Announcement****Time:**Monday, Wednesday, Friday at 10:00 AM - 10:50 AM

**Location:**Taft Hall 207**Instructor:**Jie Yang

**Office:**SEO 513

**Phone:**(312) 413-3748

**E-Mail:**jyang06 AT uic DOT edu

**Office Hours:**Monday, Wednesday, Friday at 2:00 p.m. - 3:00 p.m. (or by appointment)**Textbook:**Geof H. Givens and Jennifer A. Hoeting,*Computational Statistics*, John Wiley & Sons, Inc., 2nd edition, 2013.

Preview table of contents and preface.

**Course Contents:**EM Optimization Methods, Simulation and Monte Carlo Integration, Markov Chain Monte Carlo, Bootstrapping, Nonparametric Density Estimation, Bivariate Smoothing

**Prerequisite:**STAT 411 or consent of instructor.**Homework:**Turn in every Friday before class; half of the grade counts for completeness; half of the grade counts for correctness of one selected problem.

**Project:**Students are required to work in groups on course projects and submit their final reports before May 1st, Friday, 10:00 am. The projects may come from the optional problems assigned by the instructor or be proposed by the students themselves upon the approval of the instructor.

**Grading:**Homework 40%, Project 60%

**Grading Scale:**90% A , 80% B , 70% C , 60% D

**Course Syllabus****WEEK****SECTIONS****BRIEF DESCRIPTION**01/13 - 01/17 Introduction; 6.1; 6.2 Introduction to the Monte Carlo method; Exact simulation 01/20 - 01/24 Holiday; 6.2; 6.3 Exact simulation; Approximate simulation 01/27 - 01/31 6.3; 6.4; 6.4 Approximate simulation; Variance reduction techniques 02/03 - 02/07 1.7; 7.1; 7.1 Markov chains; Metropolis-Hastings algorithm 02/10 - 02/14 7.2; 7.2; 7.3 Gibbs sampling; Implementation 02/17 - 02/21 9.1; 9.2; 9.2 The bootstrap principle; Basic methods 02/24 - 02/28 9.2; 9.3; 9.3 Basic methods; Bootstrap inference 03/02 - 03/06 9.8; 4.1; 4.1 Permutation tests; Missing data, marginalization, and notation 03/09 - 03/13 4.2; 4.2; 4.2 The EM algorithm 03/30 - 04/03 4.3; 4.3; 10.1 EM Variants; Measures of performance 04/06 - 04/10 10.2; 10.2; 10.3 Kernel density estimation; Nonkernel methods 04/13 - 04/17 11.1; 11.2; 11.2 Predictor-response data; Linear smoothers 04/20 - 04/24 11.3; 11.3; 11.4 Comparison of linear smoothers; Nonlinear smoothers 04/27 - 05/01 11.4; 11.5; 11.5 Nonlinear smoothers; Confidence bands

**Homework**- Homework #1, due 01/24/2020

- Homework #2, due 02/07/2020

- Homework #3, data for Problem 6.4, due 02/21/2020

- Homework #4, due 03/06/2020

- Homework #5, data for Problem 9.4, data for Problem 9.5, due 03/16/2020

- Homework #6, due 04/08/2020

- Homework #7, due 04/17/2020

- Homework #1, due 01/24/2020
**Using R**- Download
**R**for Free -- the most popular software used by statisticians

**R Studio**for Free -- a convenient R programming envirenment

- Learn R in 15 Minutes

- Use R to Compute Numerical Integrals

- Downloadable Books on R:
*An Introduction to R*, by William N. Venables, David M. Smith and the R Development Core Team

*Using R for Data Analysis and Graphics - Introduction, Code and Commentary*, by John H. Maindonald

**More R Books in Different Languages ...**

- R Code for the Course
- R code for §6.1 & §6.2 (R tips, simple Monte Carlo estimator)

- R code for §6.2 (Inverse cumulative distribution, rejection sampling)

- R code for §6.2.3 (Squeezed rejection sampling)

- R code for §6.3.1 (Sampling importance resampling)

- R code for §6.4.1 (Importance sampling)

- R code for §6.4.2, §6.4.2 (Antithetic sampling, control variates)

- R code for §7.1 (Metropolis-Hastings algorithm) data for Examples 7.2, 7.3

- R code for §7.2 (Gibbs sampler)

- R code for §9.1, §9.2, §9.3 (Bootstrap) data for Examples 9.3 ~ 9.8

- R code for §4.2 (EM algorithm)

- R code for §4.2.3 (SEM algorithm)

- R code for §10.2 (Kernel density estimation) data for Examples 10.1, 10.5, data for Examples 10.2 ~ 10.4

- R code for §10.2.2 (Choice of kernel)

- R code for §10.3 (Logspline)

- R code for §11.2.1 (Constant-span running mean) data for Examples 11.1 ~ 11.7

- R code for §11.2.2 ~ §11.2.5 (Running polynomials, local regression smoothing, kernel smoother, spline smoothing)

- R code for §11.4 (Loess smoother, supersmoother) data for Example 11.8

- R code for §11.5 (Confidence bands) data for Examples 11.9 ~ 11.11

- R code for §6.1 & §6.2 (R tips, simple Monte Carlo estimator)

- Download
**Relevant Course Materials**- Textbook Website --
Datasets, Errata,
R Code

- James E. Gentle,
*Computational Statistics*, Springer, 2009 -- a good reference book

- Textbook Website --
Datasets, Errata,
R Code

UIC Home | Library | MSCS | Jie's Home