Grokking Deep Learning

Summary

Grokking Deep Learning teaches you to build deep learning neural networks from scratch! In his engaging style, seasoned deep learning expert Andrew Trask shows you the science under the hood, so you grok for yourself every detail of training neural networks.

About the Technology

Deep learning, a branch of artificial intelligence, teaches computers to learn by using neural networks, technology inspired by the human brain. Online text translation, self-driving cars, personalized product recommendations, and virtual voice assistants are just a few of the exciting modern advancements possible thanks to deep learning.

About the Book

Grokking Deep Learning teaches you to build deep learning neural networks from scratch! In his engaging style, seasoned deep learning expert Andrew Trask shows you the science under the hood, so you grok for yourself every detail of training neural networks. Using only Python and its math-supporting library, NumPy, you'll train your own neural networks to see and understand images, translate text into different languages, and even write like Shakespeare! When you're done, you'll be fully prepared to move on to mastering deep learning frameworks.

What's inside

• The science behind deep learning
• Building and training your own neural networks
• Privacy concepts, including federated learning
• Tips for continuing your pursuit of deep learning

About the Reader

For readers with high school-level math and intermediate programming skills.

About the Author

Andrew Trask is a PhD student at Oxford University and a research scientist at DeepMind. Previously, Andrew was a researcher and analytics product manager at Digital Reasoning, where he trained the world's largest artificial neural network and helped guide the analytics roadmap for the Synthesys cognitive computing platform.

Table of Contents

1. Introducing deep learning: why you should learn it
2. Fundamental concepts: how do machines learn?
3. Introduction to neural prediction: forward propagation
4. Introduction to neural learning: gradient descent
5. Learning multiple weights at a time: generalizing gradient descent
6. Building your first deep neural network: introduction to backpropagation
7. How to picture neural networks: in your head and on paper
8. Learning signal and ignoring noise:introduction to regularization and batching
9. Modeling probabilities and nonlinearities: activation functions
10. Neural learning about edges and corners: intro to convolutional neural networks
11. Neural networks that understand language: king - man + woman == ?
12. Neural networks that write like Shakespeare: recurrent layers for variable-length data
13. Introducing automatic optimization: let's build a deep learning framework
14. Learning to write like Shakespeare: long short-term memory
15. Deep learning on unseen data: introducing federated learning
16. Where to go from here: a brief guide

Andrew Trask is a PhD student at Oxford University, funded by the Oxford-DeepMind Graduate Scholarship, where he researches Deep Learning approaches with special emphasis on human language. Previously, Andrew was a researcher and analytics product manager at Digital Reasoning where he trained the world's largest artificial neural network with over 160 billion parameters, and helped guide the analytics roadmap for the Synthesys cognitive computing platform which tackles some of the most complex analysis tasks across government intelligence, finance, and healthcare industries.