DFG project “Stochastic Optimal Control and MPC – Dissipativity, Risk and Performance”
start of the project: 2022, end of the project: 2025
contract numbers: GR 1569/25-1, BA 7477/3-1
funding institution: DFG (Research Grants)
PROJECT MEMBERS
Principal investigators
Dr. Michael Baumann and Prof. Dr. Lars Grüne
Project member
External project members
Professor Dr.-Ing. Timm Faulwasser (TU Dortmund)
AIMS OF THE PROJECT
It stands to reason that three of the most impactful concepts in systems and control in the 20th century have been the optimal control siblings – i.e. the Pontryagin Maximum Principle (PMP) and Dynamic Programming together with the Hamilton-Jacobi-Bellman approach – as well as the dissipativity framework for dynamic systems coined by Jan Willems. Moreover, Model Predictive Control (MPC) can be regarded as a successful attempt to alleviate the curse of dimensionality in solving the Hamilton-Jacobi-Bellman Equation (HJBE) by resorting to a receding-horizon application of open-loop optimal inputs – either obtained directly via the PMP or via direct solution methods for optimal control.
The last decades have seen significant progress, for example, in terms of stability and performance analysis of MPC considering nonlinear prediction models, real-time implementation of MPC, MPC accounting for uncertainty surrounding system dynamics and exogenous disturbances. To this end, disturbances may be treated in a stochastic or in a worst-case manner. While the usual control-centered approach to MPC considers underlying tasks such as setpoint stabilization and trajectory tracking, in the last years several breakthroughs were obtained in analyzing MPC with generic, i.e. economic cost functions, which do not express control tasks directly. Indeed, the analysis of these schemes uses concepts from the PMP, Dynamic Programming, and dissipativity notions. Moreover, these approaches are of major interest for directly optimizing process economics via closed-loop control in various applications ranging from process industries to energy systems and economics. Yet, from a systems and control point of view, the combination of stochastic uncertainty descriptions with economic objective formulations is not well-explored, despite the fact that combining both approaches promises great potential for applications.
In this context, the present project develops new tools for analysis and numerical solution of stochastic optimal control problems and MPC. The proposed research enables the development of novel tools for economic optimization-based control of stochastic nonlinear systems. The focus of the project is on the development and understanding of stochastic dissipativity concepts and their use in analysing the closed-loop performance of stochastic economic MPC schemes. In addition to standard cost functions based on expectation and variance we also investigate risk-aware formulations. The methods are tested on benchmark problems for multi-energy systems, particularly on scheduling problems for energy storage populations under uncertainty.
See also the GEPRIS information on the project.