Development and interrater reliability testing of a telephone interview training programme for Australian nurse interviewers

Ahern, Tracey, Gardner, Anne, Gardner, Glenn, Middleton, Sandy, and Della, Phillip (2013) Development and interrater reliability testing of a telephone interview training programme for Australian nurse interviewers. Nurse Education Today, 33 (5). pp. 470-474.

[img] PDF (Published Version) - Published Version
Restricted to Repository staff only

View at Publisher Website:


Background: The final phase of a three phase study analysing the implementation and impact of the nurse practitioner role in Australia (the Australian Nurse Practitioner Project or AUSPRAC) was undertaken in 2009, requiring nurse telephone interviewers to gather information about health outcomes directly from patients and their treating nurse practitioners. A team of several registered nurses was recruited and trained as telephone interviewers. The aim of this paper is to report on development and evaluation of the training process for telephone interviewers.

Methods: The training process involved planning the content and methods to be used in the training session; delivering the session; testing skills and understanding of interviewers post-training; collecting and analysing data to determine the degree to which the training process was successful in meeting objectives and post-training follow-up. All aspects of the training process were informed by established educational principles.

Results: Interrater reliability between interviewers was high for well-validated sections of the survey instrument resulting in 100% agreement between interviewers. Other sections with unvalidated questions showed lower agreement (between 75% and 90%). Overall the agreement between interviewers was 92%. Each interviewer was also measured against a specifically developed master script or gold standard and for this each interviewer achieved a percentage of correct answers of 94.7% or better. This equated to a Kappa value of 0.92 or better.

Conclusion: The telephone interviewer training process was very effective and achieved high interrater reliability. We argue that the high reliability was due to the use of well validated instruments and the carefully planned programme based on established educational principles. There is limited published literature on how to successfully operationalise educational principles and tailor them for specific research studies; this report addresses this knowledge gap.

Item ID: 32948
Item Type: Article (Research - C1)
ISSN: 1532-2793
Keywords: nurse interviewers, nurse practitioner, interrater reliability, SF12, Charlson Comorbidity Index
Funders: Australian Research Council (ARC), Faculty of Medicine, Health and Molecular Sciences Honours scholarship, James Cook University (JCU), National Nursing and Nurse Education Taskforce, Chief Nursing Officers of Australia, Australian Nursing and Midwifery Council
Projects and Grants: ARC (LP0668886)
Date Deposited: 30 Apr 2014 09:20
FoR Codes: 11 MEDICAL AND HEALTH SCIENCES > 1110 Nursing > 111099 Nursing not elsewhere classified @ 100%
SEO Codes: 97 EXPANDING KNOWLEDGE > 970111 Expanding Knowledge in the Medical and Health Sciences @ 100%
Downloads: Total: 5
More Statistics

Actions (Repository Staff Only)

Item Control Page Item Control Page