COE 502: Parallel Processing Architecture

Course Description:

Introduction to parallel processing architecture, sequential, parallel, pipelined, and dataflow architectures. Vectorization methods, optimization and performance. Interconnection networks, routing, complexity and performance. Data-parallel paradigm and techniques. Multithreaded architecture and programming.

Lecture Slides:

  • Introduction
  • Review
  • Performance
  • Parallel Programming Models
  • Instruction-Level Parallelism
  • Shared Memory Architecture
  • Cache Coherence and Memory Consistency Models
  • Programming with OpenMP
  • Message Passing Architecture
  • Programming with MPI interface
  • Synchronization
  • Interconnection Networks