Optimize the performance of your systems with practical experiments used by engineers in the world’s most competitive industries.
In Experimentation for Engineers: From A/B testing to Bayesian optimization you will learn how to:
Design, run, and analyze an A/B test
Break the "feedback loops" caused by periodic retraining of ML models
Increase experimentation rate with multi-armed bandits
Tune multiple parameters experimentally with Bayesian optimization
Clearly define business metrics used for decision-making
Identify and avoid the common pitfalls of experimentation
Experimentation for Engineers: From A/B testing to Bayesian optimization is a toolbox of techniques for evaluating new features and fine-tuning parameters. You’ll start with a deep dive into methods like A/B testing, and then graduate to advanced techniques used to measure performance in industries such as finance and social media. Learn how to evaluate the changes you make to your system and ensure that your testing doesn’t undermine revenue or other business metrics. By the time you’re done, you’ll be able to seamlessly deploy experiments in production while avoiding common pitfalls.
Purchase of the print book includes a free eBook in PDF, Kindle, and ePub formats from Manning Publications.
About the technology
Does my software really work? Did my changes make things better or worse? Should I trade features for performance? Experimentation is the only way to answer questions like these. This unique book reveals sophisticated experimentation practices developed and proven in the world’s most competitive industries that will help you enhance machine learning systems, software applications, and quantitative trading solutions.
About the book
Experimentation for Engineers: From A/B testing to Bayesian optimization delivers a toolbox of processes for optimizing software systems. You’ll start by learning the limits of A/B testing, and then graduate to advanced experimentation strategies that take advantage of machine learning and probabilistic methods. The skills you’ll master in this practical guide will help you minimize the costs of experimentation and quickly reveal which approaches and features deliver the best business results.
What's inside
Design, run, and analyze an A/B test
Break the “feedback loops” caused by periodic retraining of ML models
Increase experimentation rate with multi-armed bandits
Tune multiple parameters experimentally with Bayesian optimization
About the reader
For ML and software engineers looking to extract the most value from their systems. Examples in Python and NumPy.
About the author
David Sweet has worked as a quantitative trader at GETCO and a machine learning engineer at Instagram. He teaches in the AI and Data Science master's programs at Yeshiva University.
Table of Contents
1 Optimizing systems by experiment
2 A/B testing: Evaluating a modification to your system
3 Multi-armed bandits: Maximizing business metrics while experimenting
4 Response surface methodology: Optimizing continuous parameters
5 Contextual bandits: Making targeted decisions
6 Bayesian optimization: Automating experimental optimization
7 Managing business metrics
8 Practical considerations
"synopsis" may belong to another edition of this title.
David Sweet is a quantitative trader and was a machine learning engineer at Instagram. He lectured on the experimental optimization methods that tune trading and recommender systems at NYU and now teaches a course on the subject in the AI and Data Science master's programs at Yeshiva University. He holds a Ph.D. in Physics, with research published in Nature, Physical Review Letters, and as an exhibit at the Museum of Mathematics in New York City.
Learn how to evaluate the changes you make to your system and ensure that your testing does not undermine revenue or other business metrics.
Experimentation for Engineers: From A/B testing to Bayesian optimization delivers a toolbox of processes for optimising software systems. From learning the limits of A/B testing to advanced experimentation strategies involving machine learning and probabilistic methods, this practical guide will help you master the skills. It will also help you minimise the costs of experimentation and will quickly reveal which approaches and features deliver the best business results.
What's insideFor ML and software engineers looking to extract the most value from their systems. Examples are found in Python and NumPy.
"About this title" may belong to another edition of this title.
FREE shipping within U.S.A.
Destination, rates & speedsSeller: INDOO, Avenel, NJ, U.S.A.
Condition: New. Seller Inventory # 9781617298158
Quantity: Over 20 available
Seller: GreatBookPrices, Columbia, MD, U.S.A.
Condition: New. Seller Inventory # 44427707-n
Quantity: Over 20 available
Seller: SecondSale, Montgomery, IL, U.S.A.
Condition: Good. Item in good condition. Textbooks may not include supplemental items i.e. CDs, access codes etc. Seller Inventory # 00082282959
Quantity: 2 available
Seller: GreatBookPrices, Columbia, MD, U.S.A.
Condition: As New. Unread book in perfect condition. Seller Inventory # 44427707
Quantity: Over 20 available
Seller: INDOO, Avenel, NJ, U.S.A.
Condition: As New. Unread copy in mint condition. Seller Inventory # SS9781617298158
Quantity: Over 20 available
Seller: PBShop.store US, Wood Dale, IL, U.S.A.
HRD. Condition: New. New Book. Shipped from UK. Established seller since 2000. Seller Inventory # PB-9781617298158
Quantity: 15 available
Seller: Rarewaves USA, OSWEGO, IL, U.S.A.
Hardback. Condition: New. Optimise the performance of your systems with practical experiments used by engineers in the world's most competitive industries. Experimentation for Engineers: From A/B testing to Bayesian optimization is a toolbox of techniques for evaluating new features and fine-tuning parameters. You will start with a deep dive into methods like A/B testing and then graduate to advanced techniques used to measure performance in industries such as finance and social media. You will learn how to: Design, run, and analyse an A/B testBreak the "feedback loops" caused by periodic retraining of ML modelsIncrease experimentation rate with multi-armed banditsTune multiple parameters experimentally with Bayesian optimisationClearly define business metrics used for decision-makingIdentify and avoid the common pitfalls of experimentation By the time you're done, you will be able to seamlessly deploy experiments in production, whilst avoiding common pitfalls. About the technology Does my software really work? Did my changes make things better or worse? Should I trade features for performance? Experimentation is the only way to answer questions like these. This unique book reveals sophisticated experimentation practices developed and proven in the world's most competitive industries and will help you enhance machine learning systems, software applications, and quantitative trading solutions. Seller Inventory # LU-9781617298158
Quantity: 10 available
Seller: PBShop.store UK, Fairford, GLOS, United Kingdom
HRD. Condition: New. New Book. Shipped from UK. Established seller since 2000. Seller Inventory # PB-9781617298158
Quantity: 15 available
Seller: THE SAINT BOOKSTORE, Southport, United Kingdom
Hardback. Condition: New. New copy - Usually dispatched within 4 working days. 218. Seller Inventory # B9781617298158
Quantity: 1 available
Seller: Grand Eagle Retail, Mason, OH, U.S.A.
Hardcover. Condition: new. Hardcover. Optimise the performance of your systems with practical experiments used by engineers in the world's most competitive industries. Experimentation for Engineers: From A/B testing to Bayesian optimization is a toolbox of techniques for evaluating new features and fine-tuning parameters. You will start with a deep dive into methods like A/B testing and then graduate to advanced techniques used to measure performance in industries such as finance and social media. You will learn how to: Design, run, and analyse an A/B testBreak the "feedback loops" caused by periodic retraining of ML modelsIncrease experimentation rate with multi-armed banditsTune multiple parameters experimentally with Bayesian optimisationClearly define business metrics used for decision-makingIdentify and avoid the common pitfalls of experimentation By the time you're done, you will be able to seamlessly deploy experiments in production, whilst avoiding common pitfalls. About the technology Does my software really work? Did my changes make things better or worse? Should I trade features for performance? Experimentation is the only way to answer questions like these. This unique book reveals sophisticated experimentation practices developed and proven in the world's most competitive industries and will help you enhance machine learning systems, software applications, and quantitative trading solutions. Experimentation for Engineers: From A/B testing to Bayesian optimization is a toolbox to help you take a deep dive into methods like A/B testing. With sophisticated experimentation practices developed in the world's most competitive industries, the book will help you enhance machine learning systems, software applications, and quantitative trading solutions. Shipping may be from multiple locations in the US or from the UK, depending on stock availability. Seller Inventory # 9781617298158
Quantity: 1 available