Title :
Robust directed tree approximations for networks of stochastic processes
Author :
Quinn, Christopher J. ; Etesami, Jalal ; Kiyavash, Negar ; Coleman, Todd P.
Author_Institution :
Dept. of Electr. & Comput. Eng, Univ. of Illinois, Urbana, IL, USA
Abstract :
We develop low-complexity algorithms to robustly identify the best directed tree approximation for a network of stochastic processes in the finite-sample regime. Directed information is used to quantify influence between stochastic processes and identify the best directed tree approximation in terms of Kullback-Leibler (KL) divergence. We provide finite-sample complexity bounds for confidence intervals of directed information estimates. We use these confidence intervals to develop a minimax framework to identify the best directed tree that is robust to point estimation errors. We provide algorithms for this minimax calculation and describe the relationships between exactness and complexity.
Keywords :
approximation theory; estimation theory; minimax techniques; stochastic processes; trees (mathematics); KL divergence; Kullback-Leibler divergence; finite-sample complexity bounds; finite-sample regime; low-complexity algorithms; minimax calculation; point estimation errors; robust directed tree approximation; stochastic processes; Decision support systems; Hafnium; Information theory; Zinc;
Conference_Titel :
Information Theory Proceedings (ISIT), 2013 IEEE International Symposium on
Conference_Location :
Istanbul
DOI :
10.1109/ISIT.2013.6620627