Automatica, Vol.50, No.11, 2822-2834, 2014
Quadratic control of stochastic hybrid systems with renewal transitions
We study the quadratic control of a class of stochastic hybrid systems with linear continuous dynamics for which the lengths of time that the system stays in each mode are independent random variables with given probability distribution functions. We derive a condition for finding the optimal feedback policy that minimizes a discounted infinite horizon cost. We show that the optimal cost is the solution to a set of differential equations with unknown boundary conditions. Furthermore, we provide a recursive algorithm for computing the optimal cost and the optimal feedback policy. The applicability of our result is illustrated through a numerical example, motivated by stochastic gene regulation in biology. (C) 2014 Elsevier Ltd. All rights reserved.
Keywords:Markov renewal processes;Semi-Markov processes;Optimal control;Stochastic hybrid systems;Renewal transitions