CUDA for Engineers: An Introduction to High-Performance Parallel Computing

The authors introduce the essentials of CUDA C programming clearly and concisely, quickly guiding you from running sample programs to building your own code. Throughout, you’ll learn from complete examples you can build, run, and modify, complemented by additional projects that deepen your understanding. All projects are fully developed, with detailed building instructions for all major platforms.

Ideal for any scientist, engineer, or student with at least introductory programming experience, this guide assumes no specialized background in GPU-based or parallel computing. In an appendix, the authors also present a refresher on C programming for those who need it.

Coverage includes

• Preparing your computer to run CUDA programs
• Understanding CUDA’s parallelism model and C extensions
• Transferring data between CPU and GPU
• Managing timing, profiling, error handling, and debugging
• Creating 2D grids
• Interoperating with OpenGL to provide real-time user interactivity
• Performing basic simulations with differential equations
• Using stencils to manage related computations across threads
• Exploiting CUDA’s shared memory capability to enhance performance
• Interacting with 3D data: slicing, volume rendering, and ray casting
• Using CUDA libraries
• Finding more CUDA resources and code

Realistic example applications include

• Visualizing functions in 2D and 3D
• Solving differential equations while changing initial or boundary conditions
• Viewing/processing images or image stacks
• Computing inner products and centroids
• Solving systems of linear algebraic equations
• Monte-Carlo computations

Duane Storti is a professor of mechanical engineering at the University of Washington in Seattle. He has thirty-five years of experience in teaching and research in the areas of engineering mathematics, dynamics and vibrations, computer-aided design, 3D printing, and applied GPU computing.

Mete Yurtoglu is currently pursuing an M.S. in applied mathematics and a Ph.D. in mechanical engineering at the University of Washington in Seattle. His research interests include GPU-based methods for computer vision and machine learning.