Development of a benchmarking tool for pharmacy students using threshold learning outcomes

Chalmers, Leanne, Nash, Rose, Holmes, Sandra, Bereznicki, Luke, Rasiah, Rohan, Cooper, Joyce, Bellingan, Michelle, and Heslop, Ian (2014) Development of a benchmarking tool for pharmacy students using threshold learning outcomes. In: Presentations from the Australasian Pharmaceutical Sciences Association Conference. From: APSA 2014: Australasian Pharmaceutical Sciences Association Conference, 5-7 December 2014, Brisbane, QLD, Australia.

PDF (Presentation) - Presentation
Download (774kB) | Preview
PDF (Abstract Only) - Published Version
Download (394kB) | Preview
View at Publisher Website:


Methods: Benchmarking is crucial for ensuring the quality of the learning experience offered by a curriculum. This project aimed to develop, refine and validate a tool based on the pharmacy threshold learning outcomes (TLOs) to facilitate benchmarking of students' performances in verbal 'capstone' assessments in Australian pharmacy programs. A pilot tool was developed and trialled by local and external examiners during the University of Tasmania (UTAS) 2013 Bachelor of Pharmacy Fourth Year verbal examinations. Usability and acceptability were assessed using a survey and the tool was evaluated for validity and inter- and intra-rater reliability using Pearson correlation coefficients (R). The tool was refined using these results, and a validation exercise is planned for late 2014.

Results: In the initial evaluation, agreement on TLO scoring was excellent between UTAS examiners (R values 0.73-0.88; n=29 comparisons); and very good between the Tasmanian and external examiners for most TLOs (R=0.59-0.68; n=12). Agreement between allocated marks and TLO scores were also very good (R=0.62-0.85; n=29). Survey results recommended improving alignment of the TLOs with the assessment activity, simplifying the rating scales and providing training regarding the tool.

Discussion: Progress is underway towards the development of a relatively simple, flexible and validated benchmarking tool to facilitate high quality student outcomes across Australian pharmacy programs. Training in the use of the tool has been identified as a major enabler of its successful and consistent application, and a scenario-based training video is currently being produced. The tool and training video will be showcased in this presentation.

Item ID: 40163
Item Type: Conference Item (Presentation)
ISBN: 978-0-646-93083-1
Related URLs:
Date Deposited: 24 Aug 2015 23:10
FoR Codes: 11 MEDICAL AND HEALTH SCIENCES > 1115 Pharmacology and Pharmaceutical Sciences > 111599 Pharmacology and Pharmaceutical Sciences not elsewhere classified @ 100%
SEO Codes: 92 HEALTH > 9299 Other Health > 929999 Health not elsewhere classified @ 100%
Downloads: Total: 118
Last 12 Months: 4
More Statistics

Actions (Repository Staff Only)

Item Control Page Item Control Page