Introduction to Parallel Computing

This chapter collects some notes on the first three lectures in the first week of the course. We introduce some terminology and end with high level parallelism.

• Introduction
  • What is a Supercomputer?
  • Measuring Performance
  • Amdahl’s and Gustafson’s Law
  • Bibliography
  • Exercises
• Classifications and Scalability
  • Types of Parallel Computers
  • Clusters and Scalability
  • Network Topologies
  • Bibliography
  • Exercises
• High Level Parallel Processing
  • GPU computing with Maple
  • Multiprocessing in Python
  • Tasking in Ada
  • Performance Monitoring
  • Exercises