Federated Learning: Theory and Practice

Federated Learning: Theory and Practi ce provides a holisti c treatment to federated learning as a distributed learning system with various forms of decentralized data and features. Part I of the book begins with a broad overview of opti mizati on fundamentals and modeling challenges, covering various aspects of communicati on effi ciency, theoretical convergence, and security. Part II features
emerging challenges stemming from many socially driven concerns of federated learning as a future public machine learning service. Part III concludes the book with a wide array of industrial applicati ons of federated learning, as well as ethical considerations, showcasing its immense potential for driving innovation while safeguarding sensitive data.

Federated Learning: Theory and Practi ce provides a comprehensive and accessible introducti on to federated learning which is suitable for researchers and students in academia, and industrial practitioners who seek to leverage the latest advance in machine learning for their entrepreneurial endeavors.

• Presents the fundamentals and a survey of key developments in the field of federated learning
• Provides emerging, state-of-the art topics that build on fundamentals
• Contains industry applications
• Gives an overview of visions of the future

Lam M. Nguyen is a Staff Research Scientist at IBM Research, Thomas J. Watson Research Center working in the intersection of Optimization and Machine Learning/Deep Learning. He is also the PI of ongoing MIT-IBM Watson AI Lab projects. Dr. Nguyen received his B.S. degree in Applied Mathematics and Computer Science from Lomonosov Moscow State University in 2008; M.B.A. degree from McNeese State University in 2013; and Ph.D. degree in Industrial and Systems Engineering from Lehigh University in 2018. Dr. Nguyen has extensive research experience in optimization for machine learning problems. He has published his work mainly in top AI/ML and Optimization publication venues, including ICML, NeurIPS, ICLR, AAAI, AISTATS, Journal of Machine Learning Research, and Mathematical Programming. He has been serving as an Action/Associate Editor for Journal of Machine Learning Research, Machine Learning, Neural Networks, IEEE Transactions on Neural Networks and Learning Systems, and Journal of Optimization Theory and Applications; an Area Chair for ICML, NeurIPS, ICLR, AAAI, CVPR, UAI, and AISTATS conferences. His current research interests include design and analysis of learning algorithms, optimization for representation learning, dynamical systems for machine learning, federated learning, reinforcement learning, time series, and trustworthy/explainable AI.

Trong Nghia Hoang: Dr. Hoang received the Ph.D. in Computer Science from National University of Singapore (NUS) in 2015. From 2015 to 2017, he was a Research Fellow at NUS. After NUS, Dr. Hoang did another postdoc at MIT (2017-2018). From 2018-2020, he was a Research Staff Member and Principal Investigator at the MIT-IBM Watson AI Lab in Cambridge, Massachusetts. In Nov 2020, Dr. Hoang joined the AWS AI Labs of Amazon in Santa Clara, California as a senior research scientist. His research interests span the broad areas of deep generative modeling with applications to (personalized) federated learning, meta learning, black-box model fusion and/or reconfiguration. He has been publishing actively to key outlets in machine learning and AI such as ICML/NeurIPS/AAAI (among others). He has also been serving as a senior program committee member at AAAI, IJCAI and a program committee member of ICML, NeurIPS, ICLR, AISTATS. He also organized a recent NeurIPS-21 workshop in Federated Learning.

Pin-Yu Chen: Dr. Pin-Yu Chen is a principal research staff member at IBM Thomas J. Watson Research Center, Yorktown Heights, NY, USA. He is also the chief scientist of RPI-IBM AI Research Collaboration and PI of ongoing MIT-IBM Watson AI Lab projects. Dr. Chen received his Ph.D. degree in electrical engineering and computer science from the University of Michigan, Ann Arbor, USA, in 2016. Dr. Chen’s recent research focuses on adversarial machine learning and robustness of neural networks. His long-term research vision is to build trustworthy machine learning systems. He is a co-author of the book “Adversarial Robustness for Machine Learning”. At IBM Research, he received several research accomplishment awards, including IBM Master Inventor, IBM Corporate Technical Award, and IBM Pat Goldberg Memorial Best Paper. His research contributes to IBM open-source libraries including Adversarial Robustness Toolbox (ART 360) and AI Explainability 360 (AIX 360). He has published more than 50 papers related to trustworthy machine learning at major AI and machine learning conferences, given tutorials at NeurIPS’22, AAAI(’22,’23), IJCAI’21, CVPR(’20,’21,’23), ECCV’20, ICASSP(’20,’22,’23), KDD’19, and Big Data’18, and organized several workshops for adversarial machine learning. He received the IEEE GLOBECOM 2010 GOLD Best Paper Award and UAI 2022 Best Paper Runner-Up Award.