TY - JOUR
T1 - A Stochastic Maximum Principle for Risk-Sensitive Mean-Field Type Control
AU - Djehiche, Boualem
AU - Tembine, Hamidou
AU - Tempone, Raul
N1 - KAUST Repository Item: Exported on 2020-10-01
PY - 2015/2/24
Y1 - 2015/2/24
N2 - In this paper we study mean-field type control problems with risk-sensitive performance functionals. We establish a stochastic maximum principle (SMP) for optimal control of stochastic differential equations (SDEs) of mean-field type, in which the drift and the diffusion coefficients as well as the performance functional depend not only on the state and the control but also on the mean of the distribution of the state. Our result extends the risk-sensitive SMP (without mean-field coupling) of Lim and Zhou (2005), derived for feedback (or Markov) type optimal controls, to optimal control problems for non-Markovian dynamics which may be time-inconsistent in the sense that the Bellman optimality principle does not hold. In our approach to the risk-sensitive SMP, the smoothness assumption on the value-function imposed in Lim and Zhou (2005) needs not be satisfied. For a general action space a Peng's type SMP is derived, specifying the necessary conditions for optimality. Two examples are carried out to illustrate the proposed risk-sensitive mean-field type SMP under linear stochastic dynamics with exponential quadratic cost function. Explicit solutions are given for both mean-field free and mean-field models.
AB - In this paper we study mean-field type control problems with risk-sensitive performance functionals. We establish a stochastic maximum principle (SMP) for optimal control of stochastic differential equations (SDEs) of mean-field type, in which the drift and the diffusion coefficients as well as the performance functional depend not only on the state and the control but also on the mean of the distribution of the state. Our result extends the risk-sensitive SMP (without mean-field coupling) of Lim and Zhou (2005), derived for feedback (or Markov) type optimal controls, to optimal control problems for non-Markovian dynamics which may be time-inconsistent in the sense that the Bellman optimality principle does not hold. In our approach to the risk-sensitive SMP, the smoothness assumption on the value-function imposed in Lim and Zhou (2005) needs not be satisfied. For a general action space a Peng's type SMP is derived, specifying the necessary conditions for optimality. Two examples are carried out to illustrate the proposed risk-sensitive mean-field type SMP under linear stochastic dynamics with exponential quadratic cost function. Explicit solutions are given for both mean-field free and mean-field models.
UR - http://hdl.handle.net/10754/622508
UR - http://ieeexplore.ieee.org/document/7047683/
UR - http://www.scopus.com/inward/record.url?scp=84937833348&partnerID=8YFLogxK
U2 - 10.1109/TAC.2015.2406973
DO - 10.1109/TAC.2015.2406973
M3 - Article
SN - 0018-9286
VL - 60
SP - 2640
EP - 2649
JO - IEEE Transactions on Automatic Control
JF - IEEE Transactions on Automatic Control
IS - 10
ER -