Communications in Information and Systems

Volume 2 (2002)

Number 3

Indefinite stochastic LQ controls with Markovian jumps in a finite time horizon

Pages: 265 – 282

DOI: https://dx.doi.org/10.4310/CIS.2002.v2.n3.a4

Authors

Xun Li (Department of Systems Engineering and Engineering Management, The Chinese University of Hong Kong, Shatin, N.T., Hong Kong)

Xun Yu Zhou (Department of Systems Engineering and Engineering Management, The Chinese University of Hong Kong, Shatin, N.T., Hong Kong)

Abstract

This paper is concerned with a stochastic linear–quadratic (LQ) control problem over a finite time horizon with Markovian jumps in the problem parameters. The problem is indefinite in that the cost weighting matrices for the state and control are allowed to be indefinite. A system of coupled generalized (differential) Riccati equations (CGREs) is introduced to cope with the indefiniteness of the problem. Specifically, it is proved that the solvability of the CGREs is sufficient for the well-posedness of the stochastic LQ problem. Moreover, it is shown that the solvability of the CGREs is necessary for the well-posedness of the stochastic LQ problem and the existence of optimal (feedback/open-loop) controls via the dynamic programming approach. An example is presented to illustrate the results established.

Keywords

indefinite stochastic LQ control, jump linear systems, coupled generalized Riccati equations, matrix pseudo-inverse, Hamilton-Jacobi-Bellman equations

Published 1 January 2002