Bland–Altman plot

Bland–Altman plot example

A Bland–Altman plot (Difference plot) in analytical chemistry and biostatistics is a method of data plotting used in analyzing the agreement between two different assays. It is identical to a Tukey mean-difference plot, the name by which it is known in other fields, but was popularised in medical statistics by J. Martin Bland and Douglas G. Altman.^[1][2]

Agreement vs correlation

Bland and Altman make the point that any two methods that are designed to measure the same parameter (or property) should have good correlation when a set of samples are chosen such that the property to be determined varies considerably. A high correlation for any two methods designed to measure the same property could thus in itself just be a sign that one has chosen a widespread sample. A high correlation does not necessarily imply that there is good agreement between the two methods.

How to construct a Bland–Altman plot

Consider a set of n samples (for example, objects of unknown volume). Both assays (for example, different methods of volume measurement) are performed on each sample, resulting in 2n data points. Each of the n samples is then represented on the graph by assigning the mean of the two measurements as the abscissa (x-axis) value, and the difference between the two values as the ordinate (y-axis) value.

Hence, the Cartesian coordinates of a given sample S with values of $S_{1}$ and $S_{2}$ determined by the two assays is

$S(x,y)=\left({\frac {S_{1}+S_{2}}{2}},S_{1}-S_{2}\right).$

For comparing the dissimilarities between the two sets of samples independently from their mean values, it is more appropriate to look at the ratio of the pairs of measurements.^[3] Log transformation (base 2) of the measurements before the analysis will enable the standard approach to be used; hence the plot will be given by the following equation:

$S(x,y)=\left({\frac {\log _{2}{S_{1}}+\log _{2}{S_{2}}}{2}},\log _{2}{S_{1}}-\log _{2}{S_{2}}\right).$

This version of the plot is used in MA plot.

Application

One primary application of the Bland–Altman plot is to compare two clinical measurements that each provide some errors in their measure.^[4] It can also be used to compare a new measurement technique or method with a gold standard, as even a gold standard does not - and should not - imply it to be without error.^[3] See Analyse-it, MedCalc, NCSS, GraphPad Prism, R, or StatsDirect for software providing Bland–Altman plots.

Bland and Altman plots are extensively used to evaluate the agreement among two different instruments or two measurements techniques. Bland and Altman plots allow us to investigate the existence of any systematic difference between the measurements (i.e., fixed bias) and to identify possible outliers. The mean difference is the estimated bias, and the SD of the differences measures the random fluctuations around this mean. If the mean value of the difference differs significantly from 0 on the basis of a 1-sample t-test, this indicates the presence of fixed bias. If there is a consistent bias, it can be adjusted for by subtracting the mean difference from the new method. It is common to compute 95% limits of agreement for each comparison (average difference ± 1.96 standard deviation of the difference), which tell us how far apart measurements by 2 methods were more likely to be for most individuals. If the differences within mean ± 1.96 SD are not clinically important, the two methods may be used interchangeably. The 95% limits of agreement can be unreliable estimates of the population parameters especially for small sample sizes so, when comparing methods or assessing repeatability, it is important to calculate confidence intervals for 95% limits of agreement. This can be done by Bland and Altman's approximate method ^[2] or by more precise methods.^[5]

Bland and Altman plots were also used to investigate any possible relationship of the discrepancies between the measurements and the true value (i.e., proportional bias). The existence of proportional bias indicates that the methods do not agree equally through the range of measurements (i.e., the limits of agreement will depend on the actual measurement). To evaluate this relationship formally, the difference between the methods should be regressed on the average of the 2 methods. When a relationship between the differences and the true value was identified (i.e., a significant slope of the regression line), regression-based 95% limits of agreement should be provided. ^[3]

Notes

A similar method was proposed in 1981 by Eksborg.^[6] This method was based on Deming regression — a method introduced by Adcock in 1878.

Bland and Altman's Lancet paper ^[2] was number 29 in a list of the top 100 most-cited papers of all time with over 23,000 citations.^[7]

See also

• MA plot

References

1. Altman DG, Bland JM (1983). "Measurement in medicine: the analysis of method comparison studies". The Statistician. 32: 307–317. doi:10.2307/2987937.
2. Bland JM, Altman DG (1986). "Statistical methods for assessing agreement between two methods of clinical measurement" (PDF). Lancet. 327 (8476): 307–10. doi:10.1016/S0140-6736(86)90837-8. PMID 2868172.
3. Bland JM, Altman DG (1999). "Measuring agreement in method comparison studies". Statistical Methods in Medical Research. 8 (2): 135–60. doi:10.1191/096228099673819272. PMID 10501650.
4. Hanneman SK (2008). "Design, analysis, and interpretation of method-comparison studies". AACN Advanced Critical Care. 19 (2): 223–234. doi:10.1097/01.AACN.0000318125.41512.a3. PMC 2944826. PMID 18560291.
5. Carkeet A (2015). "Exact parametric confidence intervals for Bland–Altman Limits of Agreement.". Optometry and Vision Science. 92 (3): pap. doi:10.1097/OPX.0000000000000513.
6. Eksborg S (1981) Evaluation of method-comparison data. Clin Chem 27:1311-1312
7. Van Noorden, Richard; Maher, Brendan; Nuzzo, Regina (2014). "The top 100 papers". Nature. 514 (7524): 550–553. doi:10.1038/514550a. ISSN 0028-0836.