Temporal difference learning waveform selection

The largest difference between cognitive radar and other adaptive radar is the adaptivity of transmitter in cognitive radar. How to optimally decide or select the radar waveform for next transmission based on the observation of past radar returns is one of the important issues. In this paper, with the stochastic dynamic programming model of waveform selection, we use the method of temporal difference learning to solve this problem and realize the adaptivity of waveform selection. The simulation results show that the uncertainty of state estimation using temporal difference learning is less than that using fixed waveform.