Do you see what i see? Quantifying inter-observer variability in an intertidal marine citizen science experiment

Earp, Hannah, Vye, Siobhan, Bohn, Katrin, Burrows, Michael, Chenery, Jade, Dickens, Stephanie, Foster, Charlotte, Grist, Hannah, Lamont, Peter, Long, Sarah, Morrall, Zoe, Pocklington, Jacqueline, Scott, Abigail, Watson, Gordon, West, Victoria, Jenkins, Stuart, Delany, Jane, and Sugden, Heather (2022) Do you see what i see? Quantifying inter-observer variability in an intertidal marine citizen science experiment. Citizen Science: Theory and Practice, 7 (1). 12.

PDF (Published Version) - Published Version
Available under License Creative Commons Attribution.

Download (1MB) | Preview
View at Publisher Website:


Citizen science represents an effective means of collecting ecological data; however, the quality/reliability of these data is often questioned. Quality assurance procedures are therefore important to determine the validity of citizen science data and to promote confidence in conclusions. Here, data generated by a marine citizen science project conducted at 12 sites across the United Kingdom was used to investigate whether the use of a simple, low-taxonomic-resolution field-monitoring protocol allowed trained citizen scientists to generate data comparable to those of professional scientists. To do this, differences between field estimates of algal percentage cover generated by different observer units (i.e., trained citizen scientists, professional scientists, and combined units), and digitally derived baseline estimates were examined. The results show that in the field, citizen scientists generated data similar to those of professional scientists, demonstrating that training, coupled with the use of a simple, low-taxonomic-resolution protocol can allow citizen scientists to generate robust datasets in which variability likely represents ecological variation/change as opposed to observer variation. The results also show, irrespective of observer unit, that differences between field and digital baseline estimates of algal percentage cover were greatest in plots with medium levels of algal cover, highlighting that additional/enhanced training for all participants could be beneficial in this area. The approach presented can serve as a guide for existing and future projects with similar protocols to assess their data quality, to strengthen participant training/protocols, and ultimately to promote the incorporation of robust citizen science datasets into environmental research and management.

Item ID: 74661
Item Type: Article (Research - C1)
ISSN: 2057-4991
Keywords: Coral Point Count, data accuracy, data verification, public participation, temperate rocky shore, volunteer
Copyright Information: © 2022 The Author(s). This is an open-access article distributed under the terms of the Creative Commons Attribution 4.0 International License (CC-BY 4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. See
Funders: Heritage Lottery Fund
Date Deposited: 14 Jun 2022 05:41
FoR Codes: 31 BIOLOGICAL SCIENCES > 3103 Ecology > 310305 Marine and estuarine ecology (incl. marine ichthyology) @ 100%
SEO Codes: 18 ENVIRONMENTAL MANAGEMENT > 1805 Marine systems and management > 180504 Marine biodiversity @ 50%
28 EXPANDING KNOWLEDGE > 2801 Expanding knowledge > 280102 Expanding knowledge in the biological sciences @ 50%
Downloads: Total: 609
Last 12 Months: 12
More Statistics

Actions (Repository Staff Only)

Item Control Page Item Control Page