A general critical appraisal tool: an evaluation of construct validity

Crowe, Michael, and Sheppard, Lorraine (2011) A general critical appraisal tool: an evaluation of construct validity. International Journal of Nursing Studies, 48 (12). pp. 1505-1516.

[img] PDF (Published Version) - Published Version
Restricted to Repository staff only

View at Publisher Website: http://dx.doi.org/10.1016/j.ijnurstu.201...

Abstract

Background: Many critical appraisal tools (CATs) exist for which there is little or no information on development of the CAT, evaluation of validity, or testing reliability. The proposed CAT was developed based on a number of other CATs, general research methods theory, and reporting guidelines but requires further study to determine its effectiveness.

Objectives: To establish a scoring system and to evaluate the construct validity of the proposed critical appraisal tool before undertaking reliability testing.

Methods: Data obtained from this exploratory study along with information on the design of the proposed CAT were combined to evaluate construct validity using the Standards for educational and psychological testing which consist of five types of evidence: test content, response process, internal structure, relations to other variables, and consequences of testing. To obtain data for internal structure and relations to other variables, the proposed CAT was analysed against five alternative CATs. A random sample of 1o papers from six different research designs across the range of health related research were selected, giving a total sample size of 60 papers. Results: In all research designs, the proposed CAT had significant (p<0.05, two tailed) weak to moderate positive correlations (Kendall’s τ 0.33–0.55) with the alternative CATs, except in the Preamble category. There were significant moderate to strong positive correlations in the quasi-experimental (τ 0.70–1.00), descriptive/exploratory/observational (τ 0.72–1.00), qualitative (τ 0.74–0.81), and systematic review (τ 0.62–0.82) designs and to a lesser extent in the true experimental (τ 0.68–0.70) design. There were no significant correlations in the single system research designs.

Conclusions: Based on the results obtained, the theory on which the proposed CAT was designed, and the objective of the proposed CAT there was enough evidence to show that inferences made from scores obtained from the proposed CAT should be sound.

Item ID: 18597
Item Type: Article (Refereed Research - C1)
Keywords: critical appraisal; evidence based practice; reliability; systematic review; validity
ISSN: 1873-491X
Date Deposited: 14 Mar 2012 03:02
FoR Codes: 11 MEDICAL AND HEALTH SCIENCES > 1199 Other Medical and Health Sciences > 119999 Medical and Health Sciences not elsewhere classified @ 50%
16 STUDIES IN HUMAN SOCIETY > 1608 Sociology > 160807 Sociological Methodology and Research Methods @ 50%
SEO Codes: 92 HEALTH > 9299 Other Health > 929999 Health not elsewhere classified @ 20%
97 EXPANDING KNOWLEDGE > 970111 Expanding Knowledge in the Medical and Health Sciences @ 60%
97 EXPANDING KNOWLEDGE > 970116 Expanding Knowledge through Studies of Human Society @ 20%
Citation Count from Web of Science Web of Science 2
Downloads: Total: 6
More Statistics

Actions (Repository Staff Only)

Item Control Page Item Control Page