Jahanbakht, Mohammad, Rahimi Azghadi, Mostafa, and Waltham, Nathan J. (2023) Semi-supervised and weakly-supervised deep neural networks and dataset for fish detection in turbid underwater videos. Ecological Informatics, 78. 102303.

Preview

PDF (Published Version) - Published Version Available under License Creative Commons Attribution Non-commercial No Derivatives. Download (3MB) | Preview

Abstract

Fish are key members of marine ecosystems, and they have a significant share in the healthy human diet. Besides, fish abundance is an excellent indicator of water quality, as they have adapted to various levels of oxygen, turbidity, nutrients, and pH. To detect various fish in underwater videos, Deep Neural Networks (DNNs) can be of great assistance. However, training DNNs is highly dependent on large, labeled datasets, while labeling fish in turbid underwater video frames is a laborious and time-consuming task, hindering the development of accurate and efficient models for fish detection. To address this problem, firstly, we have collected a dataset called FishInTurbidWater, which consists of a collection of video footage gathered from turbid waters, and quickly and weakly (i.e., giving higher priority to speed over accuracy) labeled them in a 4-times fast-forwarding software. Next, we designed and implemented a semi-supervised contrastive learning fish detection model that is self-supervised using unlabeled data, and then fine-tuned with a small fraction (20%) of our weakly labeled FishInTurbidWater data. At the next step, we trained, using our weakly labeled data, a novel weakly-supervised ensemble DNN with transfer learning from ImageNet. The results show that our semi-supervised contrastive model leads to more than 20 times faster turnaround time between dataset collection and result generation, with reasonably high accuracy (89%). At the same time, the proposed weakly-supervised ensemble model can detect fish in turbid waters with high (94%) accuracy, while still cutting the development time by a factor of four, compared to fully-supervised models trained on carefully labeled datasets. Our dataset and code are publicly available at the hyperlink FishInTurbidWater.

Item ID:	80607
Item Type:	Article (Research - C1)
ISSN:	1878-0512
Keywords:	Weakly-supervised classifier, Self-supervised learning, Deep neural networks, Contrastive learning, Transfer learning, XGBoost ensemble, Fish detection, Highly turbid waters
Copyright Information:	© 2023 The Authors. Published by Elsevier B.V. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/bync-nd/4.0/).
Date Deposited:	03 Oct 2023 00:51
FoR Codes:	46 INFORMATION AND COMPUTING SCIENCES > 4611 Machine learning > 461103 Deep learning @ 50% 30 AGRICULTURAL, VETERINARY AND FOOD SCIENCES > 3005 Fisheries sciences > 300599 Fisheries sciences not elsewhere classified @ 50%
SEO Codes:	22 INFORMATION AND COMMUNICATION SERVICES > 2204 Information systems, technologies and services > 220403 Artificial intelligence @ 40% 18 ENVIRONMENTAL MANAGEMENT > 1802 Coastal and estuarine systems and management > 180201 Assessment and management of coastal and estuarine ecosystems @ 40% 18 ENVIRONMENTAL MANAGEMENT > 1805 Marine systems and management > 180505 Measurement and assessment of marine water quality and condition @ 20%
Downloads:	Total: 28 Last 12 Months: 6
	More Statistics