WeedCLR: Weed contrastive learning through visual representations with class-optimized loss in long-tailed datasets

Saleh, Alzayat, Olsen, Alex, Wood, Jake, Philippa, Bronson, and Rahimi Azghadi, Mostafa (2024) WeedCLR: Weed contrastive learning through visual representations with class-optimized loss in long-tailed datasets. Computers and Electronics in Agriculture, 227. 109526.

[img]
Preview
PDF (Published Version) - Published Version
Available under License Creative Commons Attribution Non-commercial.

Download (7MB) | Preview
View at Publisher Website: https://doi.org/10.1016/j.compag.2024.10...
 
7


Abstract

Image classification is a crucial task in modern weed management and crop intervention technologies. However, the limited size, diversity, and balance of existing weed datasets hinder the development of deep learning models for generalizable weed identification. In addition, the expensive labeling requirements of mainstream fully-supervised weed classifiers make them cost- and time-prohibitive to deploy widely, for new weed species, and in site-specific weed management. To address these challenges, this paper proposes a novel method for Weed Contrastive Learning through visual Representations (WeedCLR), that uses class-optimized loss with Von Neumann Entropy of deep representation for weed classification. WeedCLR leverages self-supervised learning to learn rich and robust visual features without any labels and applies a class-optimized loss function to address the class imbalance problem in real-world long-tailed weed datasets. WeedCLR is evaluated on two public weed datasets: CottonWeedID15, containing 15 weed species, and DeepWeeds, containing 8 weed species. WeedCLR achieves an average accuracy improvement of 4.3% on CottonWeedID15 and 5.6% on DeepWeeds over previous methods. It also demonstrates better generalization ability and robustness to different environmental conditions than existing methods without the need for expensive and time-consuming human annotations, which could reduce deployment time from days to hours. This is fundamental in reducing weed impacts, which can grow and spread very rapidly further affecting crops and reducing yield. These significant improvements make WeedCLR an effective tool for weed classification in real-world scenarios and allow for more rapid and widespread deployment of site-specific weed management and crop intervention technologies.

Item ID: 84203
Item Type: Article (Research - C1)
ISSN: 1872-7107
Keywords: Deep learning, Long-tailed datasets, Self-supervised learning, Weed classification
Related URLs:
Copyright Information: © 2024 The Authors. Published by Elsevier B.V. This is an open access article under the CC BY-NC license (http://creativecommons.org/licenses/by-nc/4.0/).
Date Deposited: 27 Nov 2024 23:39
Downloads: Total: 7
Last 12 Months: 2
More Statistics

Actions (Repository Staff Only)

Item Control Page Item Control Page