SIAM Journal on Control and Optimization, Vol.38, No.1, 61-78, 1999
Risk-sensitive control of discrete-time Markov processes with infinite horizon
In this paper we study existence of solutions to the Bellman equation corresponding to risk-sensitive ergodic control of discrete-time Markov processes using three different approaches. Also, for particular classes of systems, asymptotics for vanishing risk factor is investigated, showing that in the limit the optimal value for an average cost per unit time is obtained.