LEGO: Learning and Graph-Optimized Modular Tracker for Online Multi-Object Tracking with Point Clouds
Zhang, Zhenrong, Liu, Jianan, Xia, Yuxuan, Huang, Tao, Han, Qing Long, and Liu, Hongbin (2025) LEGO: Learning and Graph-Optimized Modular Tracker for Online Multi-Object Tracking with Point Clouds. IEEE Transactions on Circuits and Systems for Video Technology, 36 (2). pp. 2419-2432.
|
PDF (Published Version)
- Published Version
Restricted to Repository staff only |
Abstract
Online Multi-Object Tracking (MOT) plays a pivotal role in autonomous systems. The state-of-the-art approaches usually employ a tracking-by-detection method, and data association plays a critical role. This paper proposes a learning and graph-optimized (LEGO) modular tracker to improve data association performance in the existing literature. The proposed LEGO tracker integrates graph optimization, which efficiently formulates the association score map, facilitating the accurate and efficient matching of objects across time frames. To further enhance the state update process, the Kalman filter is added to ensure consistent tracking by incorporating temporal coherence in the object states to further enhance the state update process. Our proposed method, utilising LiDAR alone, has shown exceptional performance compared to other online tracking approaches, including LiDAR-based and LiDAR-camera fusion-based methods. LEGO ranked 3<sup>rd</sup> among all trackers (both online and offline) and 2<sup>nd</sup> among all online trackers in the KITTI MOT benchmark for cars<sup>1</sup>, at the time of submitting results to KITTI object tracking evaluation ranking board. Moreover, our method also achieves competitive performance on the Waymo open dataset benchmark.
| Item ID: | 88608 |
|---|---|
| Item Type: | Article (Research - C1) |
| ISSN: | 1558-2205 |
| Keywords: | autonomous driving, data association, graph neural network, graph optimization, LiDAR, Multi-object tracking, online tracking, point cloud, track management, transformer |
| Copyright Information: | Copyright © 2026, IEEE. |
| Date Deposited: | 01 Jun 2026 07:27 |
| FoR Codes: | 46 INFORMATION AND COMPUTING SCIENCES > 4603 Computer vision and multimedia computation > 460306 Image processing @ 100% |
| SEO Codes: | 28 EXPANDING KNOWLEDGE > 2801 Expanding knowledge > 280110 Expanding knowledge in engineering @ 100% |
| More Statistics |
