Introduction to Parallel Computing

This chapter collects some notes on the first three lectures in the first week of the course. We introduce some terminology and end with high level parallelism.

• Introduction
  • What is a Supercomputer?
  • Measuring Performance
  • Amdahl’s and Gustafson’s Law
  • Bibliography
  • Exercises
• Classifications and Scalability
  • Types of Parallel Computers
  • Clusters and Scalability
  • Network Topologies
  • Bibliography
  • Exercises
• High Level Parallel Processing
  • High-Level Parallel Programming
  • Multiprocessing in Python
  • Multithreading with Julia
  • Tasking in Ada
  • Performance Monitoring
  • Bibliography
  • Exercises