This book has two main objectives:
• to provide a concise introduction to nonlinear optimization methods, which can be used as a textbook at a graduate or upper undergraduate level;
• to collect and organize selected important topics on optimization algorithms, not easily found in textbooks, which can provide material for advanced courses or can serve as a reference text for self-study and research.
The basic material on unconstrained and constrained optimization is organized into two blocks of chapters:
• basic theory and optimality conditions
• unconstrained and constrained algorithms.
These topics are treated in short chapters that contain the most important results in theory and algorithms, in a way that, in the authors’ experience, is suitable for introductory courses.
A third block of chapters addresses methods that are of increasing interest for solving difficult optimization problems. Difficulty can be typically due to the high nonlinearity of the objective function, ill-conditioning of the Hessian matrix, lack of information on first-order derivatives, the need to solve large-scale problems.
In the book various key subjects are addressed, including: exact penalty functions and exact augmented Lagrangian functions, non monotone methods, decomposition algorithms, derivative free methods for nonlinear equations and optimization problems.
The appendices at the end of the book offer a review of the essential mathematical background, including an introduction to convex analysis that can make part of an introductory course.
Prof. Luigi Grippo was formerly a full professor of operations research at the University of Rome "La Sapienza" and he taught courses on operations research, optimization algorithms, approximation methods, mathematical programming, computer learning. His research work has been mainly concerned with methods for nonlinear optimization and computer learning. He has published more than 40 papers on international journals and has served as associate editor in the Journal Optimization Methods and Software.
Prof. Marco Sciandrone is a full professor of Operations Research at University of Rome “La Sapienza”. He teaches courses on operations research, continuous optimization and machine learning. His research interests include nonlinear optimization and machine learning. He has published about 60 papers on international journals. He is associate editor of the journals Optimization Methods and Software, and 4OR. He was one of the founders of DEIX srl, a start-up of University of Rome “La Sapienza”.
