Robust estimations from distribution structures: I. Mean
Abstract: As the most fundamental problem in statistics, robust location estimation has many prominent solutions, such as the trimmed mean, Winsorized mean, Hodges Lehmann estimator, Huber M estimator, and median of means. Recent studies suggest that their maximum biases concerning the mean can be quite different, but the underlying mechanisms largely remain unclear. This study exploited a semiparametric method to classify distributions by the asymptotic orderliness of quantile combinations with varying breakdown points, showing their interrelations and connections to parametric distributions. Further deductions explain why the Winsorized mean typically has smaller biases compared to the trimmed mean; two sequences of semiparametric robust mean estimators emerge, particularly highlighting the superiority of the median Hodges Lehmann mean. This article sheds light on the understanding of the common nature of probability distributions.
- CF Gauss, Theoria combinationis observationum erroribus minimis obnoxiae. (Henricus Dieterich), (1823).
- \JournalTitleSIAM Journal on Financial Mathematics 9, 190–218 (2018).
- \JournalTitleInsurance: Mathematics and Economics 94, 9–24 (2020).
- P Daniell, Observations weighted according to order. \JournalTitleAmerican Journal of Mathematics 42, 222–236 (1920).
- JW Tukey, A survey of sampling from contaminated distributions in Contributions to probability and statistics. (Stanford University Press), pp. 448–485 (1960).
- WJ Dixon, Simplified Estimation from Censored Normal Samples. \JournalTitleThe Annals of Mathematical Statistics 31, 385 – 391 (1960).
- \JournalTitleAustralian & New Zealand Journal of Statistics 45, 83–96 (2003).
- M Bieniek, Comparison of the bias of trimmed and winsorized means. \JournalTitleCommunications in Statistics-Theory and Methods 45, 6641–6650 (2016).
- \JournalTitleUnpublished, IMPA 0 (2019).
- \JournalTitleThe Annals of Statistics 49, 393 – 410 (2021).
- \JournalTitleThe Annals of Mathematical Statistics 34, 598–611 (1963).
- F Wilcoxon, Individual comparisons by ranking methods. \JournalTitleBiometrics Bulletin 1, 80–83 (1945).
- FR Hampel, Contributions to the theory of robust estimation. (University of California, Berkeley), (1968).
- PJ Huber, Robust estimation of a location parameter. \JournalTitleAnn. Math. Statist. 35, 73–101 (1964).
- \JournalTitleJournal of the American Statistical Association 115, 254–265 (2020).
- O Catoni, Challenging the empirical mean and empirical variance: a deviation study. \JournalTitleAnnales de l’IHP Probabilités et statistiques 48, 1148–1185 (2012).
- \JournalTitleElectronic Journal of Statistics 15, 5523 – 5544 (2021).
- T Mathieu, Concentration study of m-estimators using the influence function. \JournalTitleElectronic Journal of Statistics 16, 3695–3750 (2022).
- (Wiley-Interscience), (1983).
- \JournalTitleTheoretical computer science 43, 169–188 (1986).
- pp. 20–29 (1996).
- (PMLR), pp. 37–45 (2014).
- \JournalTitleThe Annals of Statistics 44, 2695–2725 (2016).
- (PMLR), pp. 1272–1281 (2019).
- \JournalTitleThe Annals of Statistics 48, 906–931 (2020).
- B Efron, Bootstrap methods: Another look at the jackknife. \JournalTitleThe Annals of Statistics 7, 1–26 (1979).
- \JournalTitleThe annals of statistics 9, 1196–1217 (1981).
- \JournalTitleThe annals of statistics 12, 470–482 (1984).
- (CWI. Department of Operations Research, Statistics, and System Theory [BS]), (1990).
- J Neyman, On the two different aspects of the representative method: The method of stratified sampling and the method of purposive selection. \JournalTitleJournal of the Royal Statistical Society 97, 558–606 (1934).
- \JournalTitleAustralian journal of agricultural research 3, 385–390 (1952).
- \JournalTitleThe Annals of Statistics 33, 977 – 1035 (2005).
- \JournalTitleA festschrift for Erich L. Lehmann 157184 (1983).
- CM Stein, Efficient nonparametric testing and estimation in Proceedings of the third Berkeley symposium on mathematical statistics and probability. Vol. 1, pp. 187–195 (1956).
- PJ Bickel, On adaptive estimation. \JournalTitleThe Annals of Statistics 10, 647–671 (1982).
- (Springer) Vol. 4, (1993).
- \JournalTitleStatistica Neerlandica 32, 73–79 (1978).
- \JournalTitleStatistica Neerlandica 33, 1–5 (1979).
- WR van Zwet, Convex Transformations of Random Variables: Nebst Stellingen. (1964).
- K Pearson, X. contributions to the mathematical theory of evolution.—ii. skew variation in homogeneous material. \JournalTitlePhilosophical Transactions of the Royal Society of London.(A.) 186, 343–414 (1895).
- AL Bowley, Elements of statistics. (King) No. 8, (1926).
- \JournalTitleJournal of the Royal Statistical Society: Series D (The Statistician) 33, 391–399 (1984).
- JW Tukey, Exploratory data analysis. (Reading, MA) Vol. 2, (1977).
- PK Sen, On the estimation of relative potency in dilution (-direct) assays by distribution-free methods. \JournalTitleBiometrics 19, 532–552 (1963).
- \JournalTitleThe Annals of Statistics 12, 76–86 (1984).
- A Ehsanes Saleh, Hodges-lehmann estimate of the location parameter in censored samples. \JournalTitleAnnals of the Institute of Statistical Mathematics 28, 235–247 (1976).
- \JournalTitleThe Annals of Mathematical Statistics 25, 787–791 (1954).
- K Chung, Sur les lois de probabilité unimodales. \JournalTitleCOMPTES RENDUS HEBDOMADAIRES DES SEANCES DE L ACADEMIE DES SCIENCES 236, 583–584 (1953).
- IM Sobol’, On the distribution of points in a cube and the approximate evaluation of integrals. \JournalTitleZhurnal Vychislitel’noi Matematiki i Matematicheskoi Fiziki 7, 784–802 (1967).
- \JournalTitleStatistics and Computing 1, 13–22 (1991).
- MC Dutang, Package ‘randtoolbox’ (2015).
- \JournalTitleJournal of statistical software 40, 1–18 (2011).
- (John Wiley & Sons), (2011).
- (John Wiley & Sons), (2019).
- \JournalTitleBehavior research methods 52, 464–488 (2020).
- H Wickham, ggplot2: Elegant Graphics for Data Analysis. (Springer-Verlag New York), (2016).
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.