Application of ROC curve analysis to FAMACHA© evaluation of haemonchosis on two sheep farms in South Africa

Reynecke, D.P., Van Wyk, J.A., Gummow, B., Dorny, P., and Boomker, J. (2011) Application of ROC curve analysis to FAMACHA© evaluation of haemonchosis on two sheep farms in South Africa. Veterinary Parasitology, 177 (3-4). pp. 224-230.

[img] PDF (Published Version) - Published Version
Restricted to Repository staff only

View at Publisher Website: http://dx.doi.org/10.1016/j.vetpar.2010....

Abstract

Test sensitivity and specificity for the FAMACHA© clinical test for anaemia due to haemonchosis have previously been shown to be adequate in differentiating between heavily/less heavily infected sheep, but these properties give no objective guidance for setting the optimum threshold at which anthelmintic treatment should occur. The aim of this work was to use Receiver Operating Characteristic (ROC) curves to evaluate the diagnostic accuracy of FAMACHA© testing by estimating the area under the ROC curve, and to use two-graph ROC curves to decrease subjectivity in selecting treatment thresholds on two farms with contrasting management. Test diagnostic accuracy, and thus discriminating power as determined by the area under the ROC curves, ranged from "moderate to good" on the first farm, and from "moderate to high" on the second farm for haematocrit (the Gold Standard for the test) cut-offs of ≤22% and ≤19% on both farms respectively. Accuracy of classification between haematocrit cut-offs was not significantly different within farms, but did differ significantly between farms, with test accuracy being highest on the second farm at both haematocrit cut-offs (p < 0.05). The results also showed the suitability of the two-graph ROC curve approach for discriminating not only between different levels of accuracy of evaluators, but also to give an indication of the so-called ROC cut point (i.e. the desired threshold level) at which animals should be treated for a given level of risk of loss. The approach appears to have the potential not only to validate the diagnostic accuracy of the test across the complete testing range (i.e. all FAMACHA© categories from 1 to 5), but also to compensate for such inaccuracy by allowing objective adjustment of the threshold treatment level according to the output of the two-graph ROC method.

Item ID: 17957
Item Type: Article (Refereed Research - C1)
Keywords: Receiver Operating Characteristic, Haemonchus, sheep, targeted selective treatment, integrated parasite management
ISSN: 1873-2550
Date Deposited: 18 Aug 2011 05:55
FoR Codes: 07 AGRICULTURAL AND VETERINARY SCIENCES > 0707 Veterinary Sciences > 070704 Veterinary Epidemiology @ 100%
SEO Codes: 97 EXPANDING KNOWLEDGE > 970107 Expanding Knowledge in the Agricultural and Veterinary Sciences @ 100%
Citation Count from Web of Science Web of Science 2
Downloads: Total: 3
More Statistics

Actions (Repository Staff Only)

Item Control Page Item Control Page