The challenge of evaluating students' scientific literacy in a writing-to-learn context

Tomas, Louisa, and Ritchie, Stephen M. (2015) The challenge of evaluating students' scientific literacy in a writing-to-learn context. Research in Science Education, 45 (1). pp. 41-58.

PDF (Accepted Version) - Accepted Version
Download (509kB) | Preview
[img] PDF (Published Version) - Published Version
Restricted to Repository staff only

View at Publisher Website:


This paper reports on the challenge of evaluating students' scientific literacy in a writing-to-learn context, as illustrated by our experience with an online sciencewriting project. In this mixed-methods study, Year 9 students in a case study class (13-14 year olds, n = 26) authored a series of two 'hybridised' short stories that merged scientific and narratives genres about the socioscientific issue of biosecurity. In seeking to measure the efficacy of the intervention, we sought evidence of students' conceptual understanding communicated through their stories. Finding a suitable instrument presented our first challenge. This led to the development of scoring matrices to evaluate students' derived sense of scientific literacy. Student interviews were also conducted to explore their understanding of concepts related to the biosecurity context. While the results of these analyses showed significant improvements in students' understanding arising from their participation in the writing tasks, the interviews highlighted a second challenge in evaluating students' scientific literacy; a disparity between their written and vocalised understandings. The majority of students expressed a deeper level of conceptual understanding at interview than they did in their stories. The interviews also revealed alternative conceptions and instances of superficial understanding that weren't expressed in their writing. Aside from the methodological challenge of analysing stories quantitatively, these findings suggest that in a writing-to-learn context, evaluating students' scientific literacy can be difficult. An examination of these artefacts in combination with interviews about students' written work provided a more comprehensive evaluation of their developing scientific literacy. The implications of this study for our understanding of the derived sense of scientific literacy, as well as implications for classroom practice, are also discussed.

Item ID: 19432
Item Type: Article (Research - C1)
ISSN: 1573-1898
Keywords: scientific literacy, assessment, writing-to-learn, narrative, learning science, socioscientific issues
Additional Information:

The final publication is available at Springer via

Date Deposited: 02 Apr 2014 05:28
FoR Codes: 13 EDUCATION > 1302 Curriculum and Pedagogy > 130212 Science, Technology and Engineering Curriculum and Pedagogy @ 50%
13 EDUCATION > 1303 Specialist Studies in Education > 130303 Education Assessment and Evaluation @ 50%
SEO Codes: 93 EDUCATION AND TRAINING > 9301 Learner and Learning > 930101 Learner and Learning Achievement @ 50%
93 EDUCATION AND TRAINING > 9302 Teaching and Instruction > 930201 Pedagogy @ 50%
Downloads: Total: 1198
Last 12 Months: 101
More Statistics

Actions (Repository Staff Only)

Item Control Page Item Control Page