Conditional Shannon, Réyni, and Tsallis entropies estimation and asymptotic limits: discrete case

Abstract: A method of estimating the joint probability mass function of a pair of discrete random variables is described. This estimator is used to construct the conditional Shannon-R\'eyni-Tsallis entropies estimates. From there almost sure rates of convergence and asymptotic normality are established. The theorical results are validated by simulations.