Synchronized Computations

• Barriers for Synchronizations
  • Synchronizing Computations
  • The Prefix Sum Algorithm
  • Barriers in Shared Memory Parallel Programming
  • Bibliography
  • Exercises
• Parallel Iterative Methods for Linear Systems
  • Jacobi Iterations
  • A Parallel Implementation with MPI
  • Gather-to-All with MPI_Allgather
  • Exercises
• Domain Decomposition Methods
  • Gauss-Seidel Relaxation
  • Parallel Gauss-Seidel with OpenMP
  • Solving the Heat Equation
  • Solving the Heat Equation with PETSc
  • Bibliography
  • Exercises
• Parallel Gaussian Elimination
  • LU and Cholesky Factorization
  • Blocked LU Factorization
  • The PLASMA Software Library
  • Bibliography
  • Exercises
• Parallel Numerical Linear Algebra
  • QR Factorization
  • Conjugate Gradient and Krylov Subspace Methods
  • Bibliography
  • Exercises