Hands-On GPU Computing with Python

Explore GPU-enabled programmable environment for machine learning, scientific applications, and gaming using PuCUDA, PyOpenGL, and Anaconda Accelerate

Key Features

• Understand effective synchronization strategies for faster processing using GPUs
• Write parallel processing scripts with PyCuda and PyOpenCL
• Learn to use the CUDA libraries like CuDNN for deep learning on GPUs

Book Description

GPUs are proving to be excellent general purpose-parallel computing solutions for high performance tasks such as deep learning and scientific computing.

This book will be your guide to getting started with GPU computing. It will start with introducing GPU computing and explain the architecture and programming models for GPUs. You will learn, by example, how to perform GPU programming with Python, and you'll look at using integrations such as PyCUDA, PyOpenCL, CuPy and Numba with Anaconda for various tasks such as machine learning and data mining. Going further, you will get to grips with GPU work flows, management, and deployment using modern containerization solutions. Toward the end of the book, you will get familiar with the principles of distributed computing for training machine learning models and enhancing efficiency and performance.

By the end of this book, you will be able to set up a GPU ecosystem for running complex applications and data models that demand great processing capabilities, and be able to efficiently manage memory to compute your application effectively and quickly.

What you will learn

• Utilize Python libraries and frameworks for GPU acceleration
• Set up a GPU-enabled programmable machine learning environment on your system with Anaconda
• Deploy your machine learning system on cloud containers with illustrated examples
• Explore PyCUDA and PyOpenCL and compare them with platforms such as CUDA, OpenCL and ROCm.
• Perform data mining tasks with machine learning models on GPUs
• Extend your knowledge of GPU computing in scientific applications

Who this book is for

Data Scientist, Machine Learning enthusiasts and professionals who wants to get started with GPU computation and perform the complex tasks with low-latency. Intermediate knowledge of Python programming is assumed.

Table of Contents

1. Introduction to GPU computing
2. Designing A GPU Computing Strategy
3. Setting up a GPU Computing Platform with NVIDIA and AMD
4. Fundamentals of GPU programming
5. Setting up your environment for GPU programming
6. Working with PyCUDA
7. Working with PyOpenCL
8. Working with Anaconda and Anaconda Accelerate
9. Containerization on GPU enabled platforms
10. Machine Learning on GPUs: Use cases
11. GPU Acceleration for Scientific Applications using Deepchem

Avimanyu Bandyopadhyay is currently pursuing a PhD degree in Bioinformatics based on applied GPU computing in Computational Biology at Heritage Institute of Technology, Kolkata, India. Since 2014, he developed a keen interest in GPU computing, and used CUDA for his master's thesis. He has experience as a systems administrator as well, particularly on the Linux platform.

Avimanyu is also a scientific writer, technology communicator, and a passionate gamer. He has published technical writing on open source computing and has actively participated in NVIDIA's GPU computing conferences since 2016. A big-time Linux fan, he strongly believes in the significance of Linux and an open source approach in scientific research. Deep learning with GPUs is his new passion!