Structured assessment using multiple patient scenarios by videoconference in rural settings

Wilkinson, Tim J., Smith, Janie D., Margolis, Stephen A., Sen Gupta, Tarun, and Prideaux, David J. (2008) Structured assessment using multiple patient scenarios by videoconference in rural settings. Medical Education, 42 (5). pp. 480-487.

[img] PDF (Published Version)
Restricted to Repository staff only

View at Publisher Website: http://dx.doi.org/10.1111/j.1365-2923.20...

Abstract

Context: the assessment blueprint of the Australian College of Rural and Remote Medicine postgraduate curriculum highlighted a need to assess clinical reasoning. We describe the development, reliability, feasibility, validity and educational impact of an 8-station assessment tool, StAMPS (structured assessment using multiple patient scenarios), conducted by videoconference.

Methods: StAMPS asks each candidate to be examined at each of 8 stations on issues relating to patient diagnosis or management. Each candidate remains located in a rural site but is examined in turn by 8 examiners who are located at a central site. Examiners were rotated through the candidates by either walking between videoconference rooms or by connecting and disconnecting the links. Reliability was evaluated using generalisability theory. Validity and educational impact were evaluated with qualitative interviews.

Results: fourteen candidates were assessed on 82 scenarios with a reliability of G = 0.76. There was a reasonable correlation with level of candidate expertise (ρ = 0.57). The videoconference links were acceptable to candidates and examiners but the walking rotation system was more reliable. Qualitative comments confirmed relevance and acceptability of the assessment tool and suggest it is likely to have a desirable educational impact.

Conclusions: StAMPS not only reflects the content of rural and remote practice but also reflects the process of that work in that it is delivered from a distance and assesses resourcefulness and flexibility in thinking. The reliability and feasibility of this type of assessment has implications for people running any distance-based course, but the assessment could also be used in a face-to-face setting.

Item ID: 6873
Item Type: Article (Refereed Research - C1)
Keywords: remote consultation; rural health; education; videoconferencing; decision making; program evaluation
ISSN: 1365-2923
Date Deposited: 04 Mar 2010 00:33
FoR Codes: 13 EDUCATION > 1301 Education Systems > 130103 Higher Education @ 50%
13 EDUCATION > 1302 Curriculum and Pedagogy > 130209 Medicine, Nursing and Health Curriculum and Pedagogy @ 50%
SEO Codes: 93 EDUCATION AND TRAINING > 9303 Curriculum > 930301 Assessment and Evaluation of Curriculum @ 100%
Citation Count from Web of Science Web of Science 2
Downloads: Total: 2
More Statistics

Actions (Repository Staff Only)

Item Control Page Item Control Page