DocumentCode :
391236
Title :
On weak conditions and optimality inequality solutions in risk-sensitive controlled Markov processes with average criterion
Author :
Brau-Rojas, Agustin ; Fernández-Gaucherand, Emmanuel
Author_Institution :
Departamento de Matematicas, Sonora Univ., Mexico
Volume :
2
fYear :
2002
fDate :
10-13 Dec. 2002
Firstpage :
1375
Abstract :
A standard approach to the problem of finding optimal policies for controlled Markov processes with average cost is based on the existence of solutions to an average optimality equation, or an average optimality inequality (Cavazos-Cadena and Sennott (1992), Sennott (1999)). In the latter, conditions are imposed on the solutions to the inequalities such that if one such solution is found, then optimal policies are obtained for all values of the state. In Hernandez-Lerma and Lasserre, (1994), such conditions are relaxed, at the expense that perhaps optimal policies are characterized for only a proper subset of the state space. Motivated by the work in Hernandez-Lerma and Lasserre, optimality inequality results were presented in Hernandez-Hernandez and Marcus, (1999), for the risk-sensitive case, purposely trying to emulate in the risk-sensitive case what had been done previously for the risk-neutral case. However, as it is illustrated in the sequel, the results in Hernandez-Hernandez and Marcus exhibit an acute fragility not present in their risk- counterparts.
Keywords :
Markov processes; state-space methods; average optimality equation; controlled Markov chain; controlled Markov processes; discrete-time; risk-; Computer science; Cost function; Equations; Kernel; Markov processes; Measurement standards; Optimal control; Performance analysis; Process control; State-space methods;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Decision and Control, 2002, Proceedings of the 41st IEEE Conference on
ISSN :
0191-2216
Print_ISBN :
0-7803-7516-5
Type :
conf
DOI :
10.1109/CDC.2002.1184709
Filename :
1184709
Link To Document :
بازگشت