Some limitations of the concordance correlation coefficient to characterise model accuracy
Wadoux, Alexandre M.J.-C., and Minasny, Budiman (2024) Some limitations of the concordance correlation coefficient to characterise model accuracy. Ecological Informatics, 83. 102820.
|
PDF (Published Version)
- Published Version
Available under License Creative Commons Attribution. Download (2MB) | Preview |
Abstract
Perusal of the environmental modelling literature reveals that the Lin's concordance correlation coefficient is a popular validation statistic to characterise model or map quality. In this communication, we illustrate with synthetic examples three undesirable statistical properties of this coefficient. We argue that ignorance of these properties have led to a frequent misuse of this coefficient in modelling and mapping studies. The stand-alone use of the concordance correlation coefficient is insufficient because i) it does not inform on the relative contribution of bias and correlation, ii) the values cannot be compared across different datasets or studies and iii) it is prone to the same problems as other linear correlation statistics. The concordance coefficient was, in fact, thought initially for evaluating reproducibility studies over repeated trials of the same variable, not for characterising model accuracy. For the validation of models and maps, we recommend calculating statistics that, combined with the concordance correlation coefficient, represent various aspects of the model or map quality, which can be visualised together in a single figure with a Taylor or solar diagram.
| Item ID: | 94175 |
|---|---|
| Item Type: | Article (Research - C1) |
| ISSN: | 1878-0512 |
| Copyright Information: | © 2024 The Author(s). Published by Elsevier B.V. This is an open access article under the CC BY license (http://creativecommons.org/licenses/by/4.0/). |
| Date Deposited: | 01 Oct 2026 06:55 |
| FoR Codes: | 41 ENVIRONMENTAL SCIENCES > 4106 Soil sciences > 410602 Pedology and pedometrics @ 100% |
| SEO Codes: | 18 ENVIRONMENTAL MANAGEMENT > 1806 Terrestrial systems and management > 180601 Assessment and management of terrestrial ecosystems @ 100% |
| More Statistics |
Actions (Repository Staff Only)
 |
Item Control Page |