PyTorch Systems Engineering (Paperback)
Language: English
Published by Devlin Nexley, 2026
- Softcover
- New

Seller: AussieBookSeller, Truganina, VIC, AustraliaAussieBookSeller
AbeBooks seller since June 22, 2007
Condition: New
US$ 30.29
Quantity: 1 available
Add to basketItem description from seller
Paperback. PyTorch Systems Engineering is a deep, architecture-driven exploration of PyTorch as a modern execution platform for large-scale AI systems. It moves beyond model building and API usage to focus on the internal mechanisms that define performance, scalability, and reliability in production deep learning workloads.As AI systems grow in complexity-from large language models to distributed multimodal pipelines-the challenges shift away from model design and toward systems engineering: how tensors are executed across heterogeneous hardware, how autograd constructs and traverses dynamic computation graphs, how GPU memory is allocated and optimized under pressure, and how distributed training systems maintain correctness and efficiency at scale.This book treats PyTorch not as a library, but as a full runtime system composed of tightly integrated subsystems: a dynamic execution engine, a tensor computation backend, a compiler pipeline, a distributed coordination layer, and a GPU-accelerated memory management system.Throughout the book, readers will gain a practical understanding of how PyTorch actually behaves under production workloads, including its performance characteristics, internal abstractions, and failure modes.You will learn how to reason about deep learning systems in terms of execution flow, memory behavior, and infrastructure constraints rather than isolated model architectures.Key topics include: PyTorch runtime architecture and execution modelTensor memory layout, storage semantics, and GPU data movementAutograd internals and dynamic computation graph constructionCUDA execution, kernel optimization, and GPU performance tuningMixed precision training and numerical stability in large modelsCompiler pipelines including graph capture and kernel fusion systemsDistributed training architectures such as DDP and FSDPTransformer and large language model training systemsMemory optimization strategies for large-scale workloadsProduction inference pipelines and deployment architecturesPyTorch extensibility through C++ extensions and CUDA kernelsDebugging distributed systems and runtime failure modesBy the end of this book, readers will be able to design, optimize, and operate production-grade AI systems built on PyTorch, with a clear understanding of the tradeoffs that govern performance, scalability, and system reliability.This is not an introductory guide to machine learning. It is a systems engineering manual for building and scaling modern AI infrastructure with PyTorch. Advanced PyTorch engineering for runtime internals, GPU optimization, distributed training, transformers, compiler pipelines, memory management, and production AI infrastructure. This item is printed on demand. Shipping may be from our Sydney, NSW warehouse or from our UK or US warehouse, depending on stock availability.…
Seller Inventory # 9788675164159
- Title
- PyTorch Systems Engineering (Paperback)
- Author
- Devlin Nexley
- Publisher
- Devlin Nexley
- Publication year
- 2026
- Condition
- new
- Binding
- Paperback
- Language
- English
- ISBN 10
- 8675164157
- ISBN 13
- 9788675164159
PyTorch Systems Engineering is a deep, architecture-driven exploration of PyTorch as a modern execution platform for large-scale AI systems. It moves beyond model building and API usage to focus on the internal mechanisms that define performance, scalability, and reliability in production deep learning workloads.
As AI systems grow in complexity-from large language models to distributed multimodal pipelines-the challenges shift away from model design and toward systems engineering: how tensors are executed across heterogeneous hardware, how autograd constructs and traverses dynamic computation graphs, how GPU memory is allocated and optimized under pressure, and how distributed training systems maintain correctness and efficiency at scale.
This book treats PyTorch not as a library, but as a full runtime system composed of tightly integrated subsystems: a dynamic execution engine, a tensor computation backend, a compiler pipeline, a distributed coordination layer, and a GPU-accelerated memory management system.
Throughout the book, readers will gain a practical understanding of how PyTorch actually behaves under production workloads, including its performance characteristics, internal abstractions, and failure modes.
You will learn how to reason about deep learning systems in terms of execution flow, memory behavior, and infrastructure constraints rather than isolated model architectures.
Key topics include:
PyTorch runtime architecture and execution model
Tensor memory layout, storage semantics, and GPU data movement
Autograd internals and dynamic computation graph construction
CUDA execution, kernel optimization, and GPU performance tuning
Mixed precision training and numerical stability in large models
Compiler pipelines including graph capture and kernel fusion systems
Distributed training architectures such as DDP and FSDP
Transformer and large language model training systems
Memory optimization strategies for large-scale workloads
Production inference pipelines and deployment architectures
PyTorch extensibility through C++ extensions and CUDA kernels
Debugging distributed systems and runtime failure modes
By the end of this book, readers will be able to design, optimize, and operate production-grade AI systems built on PyTorch, with a clear understanding of the tradeoffs that govern performance, scalability, and system reliability.
This is not an introductory guide to machine learning. It is a systems engineering manual for building and scaling modern AI infrastructure with PyTorch.
"Synopsis" may belong to another edition of this title.
AussieBookSeller
Truganina, VIC, Australia
AbeBooks seller since June 22, 2007
Shipping rates from Australia to U.S.A.
| Item | 25 to 45 business days | 8 to 14 business days |
|---|---|---|
| First item | US$ 37.00 | US$ 44.00 |
Payment methods
Seller's business information
The Nile Group Pty Ltd
42 Apex Drive
Truganina, VIC Australia 3029
Terms of sale
We guarantee the condition of every book as it's described on the Abebooks web sites. If you're dissatisfied with your purchase (Incorrect Book/Not as Described/Damaged) or if the order hasn't arrived, you're eligible for a refund within 30 days of the estimated delivery date. If you've changed your mind about a book that you've ordered, please use the Ask bookseller a question link to contact us and we'll respond within 2 business days.
Shipping terms
Please note that titles are dispatched from our UK and NZ warehouse. Delivery times specified in shipping terms. Orders ship within 2 business days. Delivery to your door then takes 8-15 days.