Putting AI in the Critical Loop: Assured Trust and Autonomy in Human-Machine Teams

Putting AI in the Critical Loop: Assured Trust and Autonomy in Human-Machine Teams takes on the primary challenges of bidirectional trust and performance of autonomous systems, providing readers with a review of the latest literature, the science of autonomy, and a clear path towards the autonomy of human-machine teams and systems. Throughout this book, the intersecting themes of collective intelligence, bidirectional trust, and continual assurance form the challenging and extraordinarily interesting themes which will help lay the groundwork for the audience to not only bridge knowledge gaps, but also to advance this science to develop better solutions. The distinctively different characteristics and features of humans and machines are likely why they have the potential to work well together, overcoming each other's weaknesses through cooperation, synergy, and interdependence which forms a “collective intelligence.” Trust is bidirectional and two-sided; humans need to trust AI technology, but future AI technology may also need to trust humans.

• Assesses the latest research advances, engineering challenges, and the theoretical gaps surrounding the question of autonomy
• Reviews the challenges of autonomy (e.g., trust, ethics, legalities, etc.), including gaps in the knowledge of the science
• Offers a path forward to solutions
• Investigates the value of trust by humans of HMTs, as well as the bidirectionality of trust, understanding how machines learn to trust their human teammates

Prithviraj (Raj) Dasgupta is a computer engineer with the Distributed Intelligent Systems Section at the Naval Research Laboratory in Washington, D.C. His research interests are in the areas of machine learning, AI-based game playing, game theory and multi-agent systems. He received his Ph.D. in 2001 from the University of California, Santa Barbara. From 2001 to 2019, he was a full Professor with the computer science department at the University of Nebraska, Omaha where he established and directed the CMANTIC Robotics Laboratory. He has authored over 150 publications in leading journals and conferences in his research area. He is a senior member of IEEE.

James Llinas is an emeritus professor at the University at Buffalo, New York. He established and directed the Center for Multisource Information Fusion at the university, the only academic systems-centered information fusion center in the United States, leading it to carrying out well-funded multidisciplinary research for over 20 years. He was a co-author of the first book on data fusion and has co-edited and co-authored several additional books on data and information fusion. In 1998, he helped establish and was first President of the International Society for Information Fusion.

Tony Gillespie is a visiting professor at University College London and a fellow of the Royal Academy of Engineering. His career includes academic, industrial, and government research and research management. His work on ensuring highly-automated weapons meet legal requirements has been extended to other autonomous systems in recent years, authoring a book and academic papers. He has acted as a technical adviser to the UN and other meetings discussing potential bans on autonomous weapon systems.

Scott Fouse had a 42-year career in Aerospace R&D, mostly focused on exploring applications of AI to military applications. He was the VP of the Advanced Technology Center at Lockheed Martin Space where he led approximately 500 scientists and engineers performing research and development in space science and a variety of space systems-related technologies and capabilities. In prior appointments, Scott served as president and CEO of ISX Corporation and member of the Air Force Scientific Advisory Board where he supported a number of studies, directorate reviews, and chaired a study on experimentation to support disruptive innovation. Scott has a BS in Physics from the University of Central Florida and an MS in electrical engineering from the University of Southern California.

William Lawless is professor of mathematics and psychology at Paine College, GA. For his PhD topic on group dynamics, he theorized about the causes of tragic mistakes made by large organizations with world-class scientists and engineers. After his PhD in 1992, DOE invited him to join its citizens advisory board (CAB) at DOE’s Savannah River Site (SRS), Aiken, SC. As a founding member, he coauthored numerous recommendations on environmental remediation from radioactive wastes (e.g., the regulated closure in 1997 of the first two high-level radioactive waste tanks in the USA). He is a member of INCOSE, IEEE, AAAI and AAAS. His research today is on autonomous human-machine teams (A-HMT). He is the lead editor of seven published books on artificial intelligence. He was lead organizer of a special issue on “human-machine teams and explainable AI” by AI Magazine (2019). He has authored over 85 articles and book chapters, and over 175 peer-reviewed proceedings. He was the lead organizer of twelve AAAI symposia at Stanford (2020). Since 2018, he has also been serving on the Office of Naval Research's Advisory Boards for the Science of Artificial Intelligence and Command Decision Making.