Hands-On Mathematics for Deep Learning: Build a solid mathematical foundation for training efficient deep neural networks - Softcover

Dawani, Jay

Softcover

ISBN 10: 1838647295 ISBN 13: 9781838647292

Publisher: Packt Publishing, 2020

Synopsis

A comprehensive guide to getting well-versed with the mathematical techniques for building modern deep learning architectures

Key Features

• Understand linear algebra, calculus, gradient algorithms, and other concepts essential for training deep neural networks
• Learn the mathematical concepts needed to understand how deep learning models function
• Use deep learning for solving problems related to vision, image, text, and sequence applications

Book Description

Most programmers and data scientists struggle with mathematics, having either overlooked or forgotten core mathematical concepts. This book uses Python libraries to help you understand the math required to build deep learning (DL) models.

You'll begin by learning about core mathematical and modern computational techniques used to design and implement DL algorithms. This book will cover essential topics, such as linear algebra, eigenvalues and eigenvectors, the singular value decomposition concept, and gradient algorithms, to help you understand how to train deep neural networks. Later chapters focus on important neural networks, such as the linear neural network and multilayer perceptrons, with a primary focus on helping you learn how each model works. As you advance, you will delve into the math used for regularization, multi-layered DL, forward propagation, optimization, and backpropagation techniques to understand what it takes to build full-fledged DL models. Finally, you’ll explore CNN, recurrent neural network (RNN), and GAN models and their application.

By the end of this book, you'll have built a strong foundation in neural networks and DL mathematical concepts, which will help you to confidently research and build custom models in DL.

What you will learn

• Understand the key mathematical concepts for building neural network models
• Discover core multivariable calculus concepts
• Improve the performance of deep learning models using optimization techniques
• Cover optimization algorithms, from basic stochastic gradient descent (SGD) to the advanced Adam optimizer
• Understand computational graphs and their importance in DL
• Explore the backpropagation algorithm to reduce output error
• Cover DL algorithms such as convolutional neural networks (CNNs), sequence models, and generative adversarial networks (GANs)

Who this book is for

This book is for data scientists, machine learning developers, aspiring deep learning developers, or anyone who wants to understand the foundation of deep learning by learning the math behind it. Working knowledge of the Python programming language and machine learning basics is required.

About this title

About the Author

Jay Dawani is a former professional swimmer turned mathematician and computer scientist. At present, he is the founder of Lemurian Labs - a startup that is developing a next generation AI accelerator to enable deep learning on edge devices, as well as a platform for developing enterprise scale autonomous robotics. Previously he was the Director of Artificial Intelligence at Geometric Energy Corporation where he led research efforts and developed various AI based solutions for industry. He has also advised many companies including Spacebit Technology on the development of their Lunar Rover, and SiaClassic Foundation on the development of their decentralized information storage and retrieval platform. He has spent the last three years researching at the frontiers of AI with a focus on computer vision, reinforcement learning, open-ended learning, deep learning, multi-agent and complex systems, and artificial general intelligence.

Edition details

• Publisher: Packt Publishing
• Publication date: 2020
• Language: English
• ISBN 10: 1838647295
• ISBN 13: 9781838647292
• Binding: Paperback
• Number of pages: 364