On the adaptive control of a partially observable Markov decision process

Author

Fernández-Gaucherand, Emmanuel ; Arapostathis, Aristotle ; Marcus, Steven I.

Author_Institution

Dept. of Electr. & Comput. Eng., Texas Univ., Austin, TX, USA

fYear

1988

fDate

7-9 Dec 1988

Firstpage

1204

Abstract

The study represents the initial stages of a program to address the adaptive control of partially observable Markov decision processes (POMDP) with finite state, action, and observation spaces. The authors review the results on the control of POMPD with known parameters and, in particular, the results on the control of quality control/machine replacement models. They study the adaptive control of a problem with simple structure: the two-state binary replacement problem. An adaptive control algorithm is defined, and initial results in the direction of using the ODE method are obtained

Keywords

Markov processes; adaptive control; decision theory; ODE method; action spaces; adaptive control; decision theory; finite state; machine replacement; observation spaces; partially observable Markov decision process; quality control; two-state binary replacement problem; Adaptive control; Adaptive estimation; Adaptive filters; Information filtering; Information filters; Parameter estimation; Programmable control; Recursive estimation; State estimation; Stochastic processes;

fLanguage

English

Publisher

ieee

Conference_Titel

Decision and Control, 1988., Proceedings of the 27th IEEE Conference on

Conference_Location

Austin, TX

Type

conf

DOI

10.1109/CDC.1988.194512

Filename

194512