NVIDIA GPU Architecture and Performance Engineering

Ever opened a profiler, stared at a wall of numbers, and had no idea which one actually mattered?

You're not alone. Most developers learn just enough parallel programming to get a kernel running, and then spend years bumping into performance ceilings they don't fully understand. They know their code works. They just don't know why it's slow, or worse, why an optimization that should have helped made things worse instead.

This book exists to close that gap.

Are you tired of tutorials that stop at "here's your first kernel" and leave you guessing after that?

So was I, honestly. That's the problem with most beginner material in this space: it teaches you syntax, not judgment. It shows you how to launch a kernel but never explains what's actually happening inside the hardware while that kernel runs, why memory access patterns matter more than clever math, or how to tell whether your code is limited by bandwidth, by compute, or by something else entirely. This book starts where those tutorials end.

What if you could actually understand the hardware you're programming, instead of just memorizing best practices?

That's the real difference this book is built around. Rather than handing you a list of rules to follow blindly, it walks you through the architecture itself, how streaming multiprocessors work, how threads actually get scheduled, how memory hierarchies behave under pressure, so that when you hit a performance wall on your own project, you know how to diagnose it instead of guessing.

Inside, you'll work through:

• How modern GPU architecture is actually organized, and why that organization dictates everything about how you should write your code
• Memory optimization techniques that go far beyond "use shared memory," including the specific access patterns that make or break your bandwidth
• Kernel tuning strategies for occupancy, register pressure, and divergence, the three issues that quietly wreck more programs than any algorithm choice ever will
• How to scale a workload across multiple GPUs without your performance gains evaporating into communication overhead
• Real profiling workflows using industry standard tools, so you can measure instead of assume
• Applied case studies covering image processing, recommendation systems, physics simulation, and inference pipelines, not toy examples, but the kind of problems you'll actually be asked to solve

Who is this actually for?

If you've written parallel code before and want to get genuinely good at it, this is for you. Software engineers moving into performance critical systems, machine learning practitioners who want to understand what's happening beneath their frameworks, computational science researchers accelerating simulations, and computer science students who want their theoretical knowledge to translate into real, measurable performance gains.

Is this for total beginners with zero programming background?

No, and it won't pretend otherwise. This book assumes you're comfortable with C or C++ and have written at least some parallel code before. What it doesn't assume is that you already understand the hardware, and that's exactly the foundation it builds, chapter by chapter, from architecture through advanced optimization, until profiling and performance reasoning become second nature instead of guesswork.

If you're ready to stop optimizing by trial and error and start optimizing with actual understanding, this book will get you there.