A review of critical appraisal tools show they lack rigor: alternative tool structure is proposed

Crowe, Michael, and Sheppard, Lorraine (2011) A review of critical appraisal tools show they lack rigor: alternative tool structure is proposed. Journal of Clinical Epidemiology, 64 (1). pp. 79-89.

[img] PDF (Published Version) - Published Version
Restricted to Repository staff only

View at Publisher Website: http://dx.doi.org/10.1016/j.jclinepi.201...

Abstract

Objectives To evaluate critical appraisal tools (CATs) that have been through a peer-reviewed development process with the aim of analyzing well-designed, documented, and researched CATs that could be used to develop a comprehensive CAT.

Study Design and Setting A critical review of the development of CATs was undertaken.

Results Of the 44 CATs reviewed, 25 (57%) were applicable to more than one research design, 11 (25%) to true experimental studies, and the remaining 8 (18%) to individual research designs. Comprehensive explanation of how a CAT was developed and guidelines to use the CAT were available in five (11%) instances. There was no validation process reported in 11 CATs (25%) and 33 CATs (77%) had not been reliability tested. The questions and statements that made up each CAT were coded into 8 categories and 22 items such that each item was distinct from every other.

Conclusions CATs are being developed while ignoring basic research techniques, the evidence available for design, and comprehensive validation and reliability testing. The basic structure for a comprehensive CAT is suggested that requires further study to verify its overall usefulness. Meanwhile, users of CATs should be careful about which CAT they use and how they use it.

Item ID: 15601
Item Type: Article (Refereed Research - C1)
Keywords: critical appraisal; review; research methodology; validation; reliability; evidence-based practice
ISSN: 1878-5921
Date Deposited: 01 Jun 2011 04:07
FoR Codes: 16 STUDIES IN HUMAN SOCIETY > 1608 Sociology > 160807 Sociological Methodology and Research Methods @ 50%
11 MEDICAL AND HEALTH SCIENCES > 1199 Other Medical and Health Sciences > 119999 Medical and Health Sciences not elsewhere classified @ 50%
SEO Codes: 97 EXPANDING KNOWLEDGE > 970111 Expanding Knowledge in the Medical and Health Sciences @ 100%
Citation Count from Web of Science Web of Science 18
Downloads: Total: 3
More Statistics

Actions (Repository Staff Only)

Item Control Page Item Control Page