Support Options

Submit a Support Ticket


Illinois ECE 498AL: Programming Massively Parallel Processors, Lecture 13: Reductions and their Implementation

By Wen-Mei W Hwu

University of Illinois at Urbana-Champaign

Published on


Structuring Parallel Algorithms


  • Parallel Reductions
  • Parallel Prefix Sum
  • Relevance of Scan
  • Application of Scan
  • Scan on the CPU
  • First attempt Parallel Scan Algorithm
  • Work efficiency considerations
  • Improving Efficiency
  • Use Padding to reduce conflicts
  • Global Synchronization in CUDA


These lecture were breezed by Carl Pearson and Daniel Borup and then reviewed, edited ,and Uploaded by Omar Sobh.

Sponsored by


Tags, a resource for nanoscience and nanotechnology, is supported by the National Science Foundation and other funding agencies. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the National Science Foundation.