Title :
On weak conditions and optimality inequality solutions in risk-sensitive controlled Markov processes with average criterion
Author :
Brau-Rojas, Agustin ; Fernández-Gaucherand, Emmanuel
Author_Institution :
Departamento de Matematicas, Sonora Univ., Mexico
Abstract :
A standard approach to the problem of finding optimal policies for controlled Markov processes with average cost is based on the existence of solutions to an average optimality equation, or an average optimality inequality (Cavazos-Cadena and Sennott (1992), Sennott (1999)). In the latter, conditions are imposed on the solutions to the inequalities such that if one such solution is found, then optimal policies are obtained for all values of the state. In Hernandez-Lerma and Lasserre, (1994), such conditions are relaxed, at the expense that perhaps optimal policies are characterized for only a proper subset of the state space. Motivated by the work in Hernandez-Lerma and Lasserre, optimality inequality results were presented in Hernandez-Hernandez and Marcus, (1999), for the risk-sensitive case, purposely trying to emulate in the risk-sensitive case what had been done previously for the risk-neutral case. However, as it is illustrated in the sequel, the results in Hernandez-Hernandez and Marcus exhibit an acute fragility not present in their risk- counterparts.
Keywords :
Markov processes; state-space methods; average optimality equation; controlled Markov chain; controlled Markov processes; discrete-time; risk-; Computer science; Cost function; Equations; Kernel; Markov processes; Measurement standards; Optimal control; Performance analysis; Process control; State-space methods;
Conference_Titel :
Decision and Control, 2002, Proceedings of the 41st IEEE Conference on
Print_ISBN :
0-7803-7516-5
DOI :
10.1109/CDC.2002.1184709