Deep instance segmentation with automotive radar detection points

Liu, Jianan, Xiong, Weiyi, Bai, Liping, Xia, Yuxuan, Huang, Tao, Ouyang, Wanli, and Zhu, Bing (2023) Deep instance segmentation with automotive radar detection points. IEEE Transactions on Intelligent Vehicles, 8 (1). pp. 84-94.

[img] PDF (Publisher Accepted Version) - Published Version
Restricted to Repository staff only

View at Publisher Website:


Automotive radar provides reliable environmental perception in all-weather conditions with affordable cost, but it hardly supplies semantic and geometry information due to the sparsity of radar detection points. With the development of automotive radar technologies in recent years, instance segmentation becomes possible by using automotive radar. Its data contain contexts such as radar cross section and micro-Doppler effects, and sometimes can provide detection when the field of view is obscured. The outcome from instance segmentation could be potentially used as the input of trackers for tracking targets. The existing methods often utilize a clustering-based classification framework, which fits the need of real-time processing but has limited performance due to minimum information provided by sparse radar detection points. In this paper, we propose an efficient method based on clustering of estimated semantic information to achieve instance segmentation for the sparse radar detection points. In addition, we show that the performance of the proposed approach can be further enhanced by incorporating the visual multi-layer perceptron. The effectiveness of the proposed method is verified by experimental results on the popular RadarScenes dataset, achieving 89.53% mean coverage and 86.97% mean average precision with the IoU threshold of 0.5, which is superior to other approaches in the literature. More significantly, the consumed memory is around 1MB, and the inference time is less than 40ms, indicating that our proposed algorithm is storage and time efficient. These two criteria ensure the practicality of the proposed method in real-world systems.

Item ID: 73631
Item Type: Article (Research - C1)
ISSN: 2379-8904
Keywords: Autonomous driving, environmental perception, instance segmentation, semantic segmentation, clustering, automotive radar, deep learning.
Copyright Information: © Copyright 2022 IEEE - All rights reserved.
Funders: Australian Research Council (ARC)
Projects and Grants: ARC DP220101634, ARC DP200103223
Date Deposited: 08 Jun 2022 04:20
FoR Codes: 40 ENGINEERING > 4002 Automotive engineering > 400203 Automotive mechatronics and autonomous systems @ 40%
46 INFORMATION AND COMPUTING SCIENCES > 4611 Machine learning > 461103 Deep learning @ 60%
SEO Codes: 24 MANUFACTURING > 2415 Transport equipment > 241502 Automotive equipment @ 40%
22 INFORMATION AND COMMUNICATION SERVICES > 2204 Information systems, technologies and services > 220403 Artificial intelligence @ 60%
Downloads: Total: 4
More Statistics

Actions (Repository Staff Only)

Item Control Page Item Control Page