Programming Massively Parallel Processors A Hands-on Approach [Paperback]

Programming Massively Parallel Processors: A Hands-on Approach, Third Edition shows both student and professional alike the basic concepts of parallel programming and GPU architecture, exploring, in detail, various techniques for constructing parallel programs.

Case studies demonstrate the development process, detailing computational thinking and ending with effective and efficient parallel programs. Topics of performance, floating-point format, parallel patterns, and dynamic parallelism are covered in-depth.

For this new edition, the authors have updated their coverage of CUDA, including coverage of newer libraries, such as CuDNN, moved content that has become less important to appendices, added two new chapters on parallel patterns, and updated case studies to reflect current industry practices.

• Teaches computational thinking and problem-solving techniques that facilitate high-performance parallel computing
• Utilizes CUDA version 7.5, NVIDIA's software development tool created specifically for massively parallel environments
• Contains new and updated case studies
• Includes coverage of newer libraries, such as CuDNN for Deep Learning

1. Introduction 2. Data parallel computing 3. Scalable parallel execution 4. Memory and data locality 5. Performance considerations 6. Numerical considerations 7. Parallel patterns: convolution: An introduction to stencil computation 8. Parallel patterns: prefix sum: An introduction to work efficiency in parallel algorithms 9. Parallel patterns-parallel histogram computation: An introduction to atomic operations and privatization 10. Parallel patterns: sparse matrix computation: An introduction to data compression and regularization 11. Parallel patterns: merge sort: An introduction to tiling with dynamic input data identification 12.lS-