A Markov Decision Approach to Feedback Channel Capacity

We introduce a general framework for treating channels with memory and feedback. First, we generalize Massey’s concept of directed information [7] and use it to characterize the feedback capacity of general channels. Second, we present coding results for Markov channels. Third, a dynamic programming framework for computing the capacity of Markov channels with output feedback is presented.