Hodges–Lehmann estimator

In statistics, the Hodges–Lehmann estimator is a robust and nonparametric estimator of a population's location parameter. For populations that are symmetric about one median, such as the (Gaussian) normal distribution or the Student t-distribution, the Hodges–Lehmann estimator is a consistent and median-unbiased estimate of the population median. For non-symmetric populations, the Hodges–Lehmann estimator estimates the "pseudo–median", which is closely related to the population median.

The Hodges–Lehmann estimator was proposed originally for estimating the location parameter of one-dimensional populations, but it has been used for many more purposes. It has been used to estimate the differences between the members of two populations. It has been generalized from univariate populations to multivariate populations, which produce samples of vectors.

It is based on the Wilcoxon signed-rank statistic. In statistical theory, it was an early example of an rank-based estimator, an important class of estimators both in nonparametric statistics and in robust statistics. The Hodges–Lehmann estimator was proposed in 1963 independently by Pranab Kumar Sen and by Joseph Hodges and Erich Lehmann, and so it is also called the "Hodges–Lehmann–Sen estimator".^[1]

Definition

In the simplest case, the "Hodges–Lehmann" statistic estimates the location parameter for a univariate population.^[2][3] Its computation can be described quickly. For a dataset with n measurements, the set of all possible one- or two-element subsets of it has n(n + 1)/2 elements. For each such subset, the mean is computed; finally, the median of these n(n + 1)/2 averages is defined to be the Hodges–Lehmann estimator of location.

The Hodges–Lehmann statistic also estimates the difference between two populations. For two sets of data with m and n observations, the set of two-element sets made of them is their Cartesian product, which contains m × n pairs of points (one from each set); each such pair defines one difference of values. The Hodges–Lehmann statistic is the median of the m × n differences.^[4]

Estimating the population median of a symmetric population

For a population that is symmetric, the Hodges–Lehmann statistic estimates the population's median. It is a robust statistic that has a breakdown point of 0.29, which means that the statistic remains bounded even if nearly 30 percent of the data have been contaminated. This robustness is an important advantage over the sample mean, which has a zero breakdown point, being proportional to any single observation and so liable to being misled by even one outlier. The sample median is even more robust, having a breakdown point of 0.50.^[5] The Hodges–Lehmann estimator is much better than the sample mean when estimating mixtures of normal distributions, also.^[6]

For symmetric distributions, the Hodges–Lehmann statistic has greater efficiency than does the sample median. For the normal distribution, the Hodges-Lehmann statistic is nearly as efficient as the sample mean. For the Cauchy distribution (Student t-distribution with one degree of freedom), the Hodges-Lehmann is infinitely more efficient than the sample mean, which is not a consistent estimator of the median.^[5]

For non-symmetric populations, the Hodges-Lehmann statistic estimates the population's "pseudo-median",^[7] a location parameter that is closely related to the median. The difference between the median and pseudo-median is relatively small, and so this distinction is neglected in elementary discussions. Like the spatial median,^[8] the pseudo–median is well defined for all distributions of random variables having dimension two or greater; for one-dimensional distributions, there exists some pseudo–median, which need not be unique, however. Like the median, the pseudo–median is defined for even heavy–tailed distributions that lack any (finite) mean.^[9]

The one-sample Hodges–Lehmann statistic need not estimate any population mean, which for many distributions does not exist. The two-sample Hodges–Lehmann estimator need not estimate the difference of two means or the difference of two (pseudo-)medians; rather, it estimates the differences between the population of the paired random–variables drawn respectively from the populations.^[4]

In general statistics

The Hodges–Lehmann univariate statistics have several generalizations in multivariate statistics:^[10]

• Multivariate ranks and signs^[11]
• Spatial sign tests and spatial medians^[8]
• Spatial signed-rank tests^[12]
• Comparisons of tests and estimates^[13]
• Several-sample location problems^[14]

See also

• Median-unbiased estimator

Notes

1. Lehmann (2006, pp. 176 and 200–201)
2. Dodge, Y. (2003) The Oxford Dictionary of Statistical Terms, OUP. ISBN 0-19-850994-4 Entry for "Hodges-Lehmann one-samaple estimator"
3. Hodges & Lehmann (1963)
4. Everitt (2002) Entry for "Hodges-Lehmann estimator"
5. Myles Hollander. Douglas A. Wolfe. Nonparametric statistical methods. 2nd ed. John Wiley.
6. Jureckova Sen. Robust Statistical Procedures.
7. Hettmansperger & McKean (1998, pp. 2–4)
8. Oja (2010, p. 71)
9. Hettmansperger & McKean (1998, pp. 2–4 and 355–356)
10. Oja (2010, pp. 2–3)
11. Oja (2010, p. 34)
12. Oja (2010, pp. 83–94)
13. Oja (2010, pp. 98–102)
14. Oja (2010, pp. 160, 162, and 167–169)

References

• Everitt, B.S. (2002) The Cambridge Dictionary of Statistics, CUP. ISBN 0-521-81099-X
• Hettmansperger, T. P.; McKean, J. W. (1998). Robust nonparametric statistical methods. Kendall's Library of Statistics. 5 (First ed., rather than Taylor and Francis (2010) second ed.). London; New York: Edward Arnold; John Wiley and Sons, Inc. pp. xiv+467. ISBN 0-340-54937-8. MR 1604954.
• Hodges, J. L.; Lehmann, E. L. (1963). "Estimation of location based on ranks". Annals of Mathematical Statistics. 34 (2): 598–611. doi:10.1214/aoms/1177704172. JSTOR 2238406. MR 152070. Zbl 0203.21105. PE euclid.aoms/1177704172.
• Lehmann, Erich L. (2006). Nonparametrics: Statistical methods based on ranks. With the special assistance of H. J. M. D'Abrera (Reprinting of 1988 revision of 1975 Holden-Day ed.). New York: Springer. pp. xvi+463. ISBN 978-0-387-35212-1. MR 395032.
• Oja, Hannu (2010). Multivariate nonparametric methods with R: An approach based on spatial signs and ranks. Lecture Notes in Statistics. 199. New York: Springer. pp. xiv+232. doi:10.1007/978-1-4419-0468-3. ISBN 978-1-4419-0467-6. MR 2598854.
• Sen, Pranab Kumar (December 1963). "On the estimation of relative potency in dilution(-direct) assays by distribution-free methods". Biometrics. 19 (4): 532–552. doi:10.2307/2527532. JSTOR 2527532. Zbl 0119.15604.