On the statistical estimation of Rényi entropies

Estimating entropies is important in many fields including statistical physics, machine learning and statistics. While the Shannon logarithmic entropy is the most fundamental, other Reacutenyi entropies are also of importance. In this paper, we derive a bias corrected estimator for a subset of Renyi entropies. The advantage of the estimator is demonstrated via theoretical and experimental considerations.