Machine Learning System Design: With end-to-end examples - Softcover

Babushkin, Valerii; Kravchenko, Arseny

Softcover

ISBN 10: 1633438759 ISBN 13: 9781633438750

Publisher: Manning Publications, 2025

Synopsis

Get the big picture and the important details with this end-to-end guide for designing highly effective, reliable machine learning systems.

From information gathering to release and maintenance, Machine Learning System Design guides you step-by-step through every stage of the machine learning process. Inside, you’ll find a reliable framework for building, maintaining, and improving machine learning systems at any scale or complexity.

In Machine Learning System Design: With end-to-end examples you will learn:

• The big picture of machine learning system design
• Analyzing a problem space to identify the optimal ML solution
• Ace ML system design interviews
• Selecting appropriate metrics and evaluation criteria
• Prioritizing tasks at different stages of ML system design
• Solving dataset-related problems with data gathering, error analysis, and feature engineering
• Recognizing common pitfalls in ML system development
• Designing ML systems to be lean, maintainable, and extensible over time

Authors Valeri Babushkin and Arseny Kravchenko have filled this unique handbook with campfire stories and personal tips from their own extensive careers. You’ll learn directly from their experience as you consider every facet of a machine learning system, from requirements gathering and data sourcing to deployment and management of the finished system.

About the technology

Designing and delivering a machine learning system is an intricate multistep process that requires many skills and roles. Whether you’re an engineer adding machine learning to an existing application or designing a ML system from the ground up, you need to navigate massive datasets and streams, lock down testing and deployment requirements, and master the unique complexities of putting ML models into production. That’s where this book comes in.

About the book

Machine Learning System Design shows you how to design and deploy a machine learning project from start to finish. You’ll follow a step-by-step framework for designing, implementing, releasing, and maintaining ML systems. As you go, requirement checklists and real-world examples help you prepare to deliver and optimize your own ML systems. You’ll especially love the campfire stories and personal tips, and ML system design interview tips.

What's inside

• Metrics and evaluation criteria
• Solve common dataset problems
• Common pitfalls in ML system development
• ML system design interview tips

About the reader

For readers who know the basics of software engineering and machine learning. Examples in Python.

About the author

Valerii Babushkin is an accomplished data science leader with extensive experience. He currently serves as a Senior Principal at BP. Arseny Kravchenko is a seasoned ML engineer currently working as a Senior Staff Machine Learning Engineer at Instrumental.

Table of Contents

Part 1
1 Essentials of machine learning system design
2 Is there a problem?
3 Preliminary research
4 Design document
Part 2
5 Loss functions and metrics
6 Gathering datasets
7 Validation schemas
8 Baseline solution
Part 3
9 Error analysis
10 Training pipelines
11 Features and feature engineering
12 Measuring and reporting results
Part 4
13 Integration
14 Monitoring and reliability
15 Serving and inference optimization
16 Ownership and maintenance

About this title

About the Author

Valerii Babushkin is an accomplished data science leader with extensive experience in the tech industry. He currently serves as the VP of Data Science at Blockchain.com, where he is responsible for leading the company's data-driven initiatives. Prior to joining Blockchain.com, Valerii held key roles at leading tech companies, such as Facebook, Alibaba, and X5 Retail Group.

Arseny Kravchenko is a seasoned ML engineer with a proven track record of building and optimizing reliable ML systems for startups, including real-time video processing, manufacturing optimization, and financial transactions analysis.

From the Back Cover

From the back cover:

In Machine Learning System Design: With end-to-end examples you'll find a step-by-step framework for creating, implementing, releasing, and maintaining your ML system. Every part of the life cycle is covered, from information gathering to keeping your system well-serviced. Each stage includes its own handy checklist of requirements and is fully illustrated with real-world examples, including interesting anecdotes from the author's own careers.

You'll follow two example companies each building a new ML system, exploring how their needs are expressed in design documents and learning best practices by writing your own. Along the way, you'll learn how to ace ML system design interviews, even at highly competitive FAANG-like companies, and improve existing ML systems by identifying bottlenecks and optimizing system performance.

About the reader:

For readers who know the basics of both software engineering and machine learning. Examples in Python.

Edition details

• Publisher: Manning Publications
• Publication date: 2025
• Language: English
• ISBN 10: 1633438759
• ISBN 13: 9781633438750
• Binding: Paperback
• Number of pages: 376