Sequential Decision-Making Problems: Representation and Solution

Numerous formalisms have been designed to model and solve decision-making problems. Some formalisms, such as constraint networks, can express "simple" decision problems, while others take into account uncertainties (probabilities, possibilities...), unfeasible decisions, and utilities (additive or not).

In the first part of this book, we introduce a generic algebraic framework that encompasses and unifies a large number of such formalisms. This formalism, called the Plausibility–Feasibility–Utility (PFU) framework, is based on algebraic structures, graphical models, and sequences of quantifications. This work on knowledge representation is completed by a work on algorithms for answering queries formulated in the PFU framework. The algorithms defined are based on variable elimination or tree search, and work on a new generic architecture for local computations called multi-operator cluster DAGs.

Cédric Pralet, a graduate from a French engineering school with a PhD in Computer Sciences, is now working as a research engineer at ONERA (French Aerospace Lab).

Thomas Schiex is working at INRA (French Institute for Agronomical Research) on algorithms for constraint networks and graphical models, and their applications in computational biology.

Gérard Verfaillie's research activity at ONERA is related to models, methods, and tools for combinatorial optimization and constrained optimization, especially for planning and decision-making.