Practical GPU Programming

Maris Fenlor

ISBN 10: 9349174790 / ISBN 13: 9789349174795

Published by Gitforgits Feb 2025, 2025

About this Item

This item is printed on demand - Print on Demand Titel. Neuware -If you're a Python pro looking to get the most out of your code with GPUs, then Practical GPU Programming is the right book for you. This book will walk you through the basics of GPU architectures, show you hands-on parallel programming techniques, and give you the know-how to confidently speed up real workloads in data processing, analytics, and engineering.The first thing you'll do is set up the environment, install CUDA, and get a handle on using Python libraries like PyCUDA and CuPy. You'll then dive into memory management, kernel execution, and parallel patterns like reductions and histogram computations. Then, we'll dive into sorting and search techniques, but with a focus on how GPU acceleration transforms business data processing. We'll also put a strong emphasis on linear algebra to show you how to supercharge classic vector and matrix operations with cuBLAS and CuPy. Plus, with batched computations, efficient broadcasting, custom kernels, and mixed-library workflows, you can tackle both standard and advanced problems with ease.Throughout, we evaluate numerical accuracy and performance side by side, so you can understand both the strengths and limitations of GPU-based solutions. The book covers nearly every essential skill and modern toolkit for practical GPU programming, but it's not going to turn you into a master overnight.Key LearningsBoost processing speed and efficiency for data-intensive tasks.Use CuPy and PyCUDA to write and execute custom CUDA kernels.Maximize GPU occupancy and throughput efficiency by using optimal thread block and grid configuration.Reduce global memory bottlenecks in kernels by using shared memory and coalesced access patterns.Perform dynamic kernel compilation to ensure tailored performance.Use CuPy to carry out custom, high-speed elementwise GPU operations and expressions.Implement bitonic and radix sort algorithms for large or batch integer datasets.Execute parallel linear search kernels to detect patterns rapidly.Scale matrix operations using Batched GEMM and high-level cuBLAS routines.Table of ContentIntroduction to GPU FundamentalsSetting up GPU Programming EnvironmentBasic Data Transfers and Memory TypesSimple Parallel PatternsIntroduction to Kernel OptimizationWorking with PyCUDA and CuPy FeaturesPractical Sorting and SearchLinear Algebra Essentials on GPULibri GmbH, Europaallee 1, 36244 Bad Hersfeld 130 pp. Englisch.

Seller Inventory # 9789349174795

Bibliographic Details

• Title: Practical GPU Programming
• Publisher: Gitforgits Feb 2025
• Publication Date: 2025
• Language: English
• ISBN 10: 9349174790
• ISBN 13: 9789349174795
• Binding: Taschenbuch
• Condition: Neu
• Dimensions: 235W x 191H x 7D millimeters 235 millimeters width by 191 millimeters height by 7 millimeters depth
• Weight: 259 grams

About this title

Synopsis

If you're a Python pro looking to get the most out of your code with GPUs, then Practical GPU Programming is the right book for you. This book will walk you through the basics of GPU architectures, show you hands-on parallel programming techniques, and give you the know-how to confidently speed up real workloads in data processing, analytics, and engineering.

The first thing you'll do is set up the environment, install CUDA, and get a handle on using Python libraries like PyCUDA and CuPy. You'll then dive into memory management, kernel execution, and parallel patterns like reductions and histogram computations. Then, we'll dive into sorting and search techniques, but with a focus on how GPU acceleration transforms business data processing. We'll also put a strong emphasis on linear algebra to show you how to supercharge classic vector and matrix operations with cuBLAS and CuPy. Plus, with batched computations, efficient broadcasting, custom kernels, and mixed-library workflows, you can tackle both standard and advanced problems with ease.

Throughout, we evaluate numerical accuracy and performance side by side, so you can understand both the strengths and limitations of GPU-based solutions. The book covers nearly every essential skill and modern toolkit for practical GPU programming, but it's not going to turn you into a master overnight.

Key Learnings

• Boost processing speed and efficiency for data-intensive tasks.
• Use CuPy and PyCUDA to write and execute custom CUDA kernels.
• Maximize GPU occupancy and throughput efficiency by using optimal thread block and grid configuration.
• Reduce global memory bottlenecks in kernels by using shared memory and coalesced access patterns.
• Perform dynamic kernel compilation to ensure tailored performance.
• Use CuPy to carry out custom, high-speed elementwise GPU operations and expressions.
• Implement bitonic and radix sort algorithms for large or batch integer datasets.
• Execute parallel linear search kernels to detect patterns rapidly.
• Scale matrix operations using Batched GEMM and high-level cuBLAS routines.

Table of Content

1. Introduction to GPU Fundamentals
2. Setting up GPU Programming Environment
3. Basic Data Transfers and Memory Types
4. Simple Parallel Patterns
5. Introduction to Kernel Optimization
6. Working with PyCUDA and CuPy Features
7. Practical Sorting and Search
8. Linear Algebra Essentials on GPU