Introduction to Threading and Tasking

To program shared memory parallel computers, we can apply Open MP, the pthreads library in C, the Intel Threading Building blocks in C++, or the tools available in Julia.

• Introduction to OpenMP
  • programming shared memory parallel computers
  • multithreading in Julia
  • the OpenMP Application Program Interface
  • using OpenMP
  • Numerical Integration with OpenMP
  • Bibliography
  • Exercises
• The Crew of Threads Model
  • Multithreaded Processes
  • The Work Crew Model
  • A Crew of Workers with Julia
  • Processing a Job Queue
  • Processing the Jobs with OpenMP
  • The POSIX Threads Programming Interface
  • Implementing a Critical Section with mutex
  • The Dining Philosophers Problem
  • Bibliography
  • Exercises
• Tasking with OpenMP
  • Parallel Recursive Functions
  • Parallel Recursive Quadrature
  • Bernstein’s Conditions
  • Task Dependencies
  • Parallel Blocked Matrix Multiplication
  • Bibliography
  • Exercises
• Tasking with Julia
  • Parallel Recursive Functions
  • Parallel Recursive Quadrature
  • Parallel Merge Sort
  • Basic Linear Algebra Subprograms
  • Exercises
• Evaluating Parallel Performance
  • Metrics
  • Isoefficiency
  • Task Graph Scheduling
  • The Roofline Model
  • Bibliography
• Work Stealing
  • Work Stealing Simulated by a Julia Program
  • Multithreading in Python with Numba
  • Multithreading in Python with Parsl
  • the Intel Threading Building Blocks (TBB)
  • using the parallel_for
  • using the parallel_reduce
  • Bibliography
  • Exercises