Adaptive Density Estimation Using Projection Kernels and Penalized Comparison to Overfitting

Abstract: In this work, we study wavelet projection estimators for density estimation, focusing on their construction from $\mathcal{S}$-regular, compactly supported wavelet bases. A key aspect of such estimators is the choice of the resolution level, which controls the balance between bias and variance. To address this, we employ the Penalized Comparison to Overfitting (PCO) method, providing a fully data-driven selection of the multiresolution level. This approach ensures both statistical accuracy and computational feasibility, while retaining the adaptability of wavelet methods. Our results establish an oracle inequality for the proposed estimator and show that it attains the optimal rate of convergence in density estimation.