Title :
Preprocessing for Point-Based Algorithms of POMDPs
Author :
Bian, Ai-Hua ; Wang, Chong-Jun ; Chen, Shi-Fu
Author_Institution :
Nat. Key Lab. for Novel Software Technol., Nanjing Univ., Nanjing
Abstract :
Point-based algorithms are a class of approximate methods for Partially Observable Markov Decision Processes (POMDPs). They do backup operators on a belief set only. This paper will propose a preprocessing method for point-based algorithms (PPBA). This method preprocesses each sampled belief point, and before generating alpha-vectors it estimates which action and alpha-vectors to be selected first, in so doing repeated computing is eliminated. Base-alpha is also defined in this paper, which cancels meaningless computing with sparseness of problem.
Keywords :
decision theory; mathematical operators; sampling methods; vectors; alpha-vector; backup operator; partially observable Markov decision process; point-based algorithm; sampled belief point; Artificial intelligence; Decision making; History; Laboratories; Operations research; Robots; Software algorithms; Software tools; Uncertainty; Upper bound; POMDP; Point-Based; preprocessing;
Conference_Titel :
Tools with Artificial Intelligence, 2008. ICTAI '08. 20th IEEE International Conference on
Conference_Location :
Dayton, OH
Print_ISBN :
978-0-7695-3440-4
DOI :
10.1109/ICTAI.2008.45