On the Federated Learning Framework for Cooperative Perception

Zhang, Zhenrong, Liu, Jianan, Zhou, Xi, Huang, Tao, Han, Qing Long, Liu, Jingxin, and Liu, Hongbin (2024) On the Federated Learning Framework for Cooperative Perception. IEEE Robotics and Automation Letters, 9 (11). pp. 9423-9430.

[img] PDF (Published Version) - Published Version
Restricted to Repository staff only

View at Publisher Website: https://doi.org/10.1109/LRA.2024.3457374
4


Abstract

Cooperative perception (CP) is essential to enhance the efficiency and safety of future transportation systems, requiring extensive data sharing among vehicles on the road, which raises significant privacy concerns. Federated learning offers a promising solution by enabling data privacy-preserving collaborative enhancements in perception, decision-making, and planning among connected and autonomous vehicles (CAVs). However, federated learning is impeded by significant challenges arising from data heterogeneity across diverse clients, potentially diminishing model accuracy and prolonging convergence periods. This study introduces a specialized federated learning framework for CP, termed the federated dynamic weighted aggregation (FedDWA) algorithm, facilitated by dynamic adjusting loss (DALoss) function. This framework employs dynamic client weighting to direct model convergence and integrates a novel loss function that utilizes Kullback-Leibler divergence (KLD) to counteract the detrimental effects of non-independently and identically distributed (Non-IID) and unbalanced data. Utilizing the BEV transformer as the primary model, our rigorous testing on FedBEVT dataset which is expanded on OpenV2V dataset, demonstrates significant improvements in the average intersection over union (IoU). These results highlight the substantial potential of our federated learning framework to address data heterogeneity challenges in CP, thereby enhancing the accuracy of perception models and facilitating more robust and efficient collaborative learning solutions in the transportation sector.

Item ID: 87459
Item Type: Article (Research - C1)
ISSN: 2377-3766
Keywords: autonomous driving, bird's-eye-view segmentation, Cooperative intelligent transportation system, cooperative perception, federated learning
Copyright Information: © 2024 IEEE.
Date Deposited: 09 Dec 2025 02:05
FoR Codes: 40 ENGINEERING > 4007 Control engineering, mechatronics and robotics > 400799 Control engineering, mechatronics and robotics not elsewhere classified @ 100%
SEO Codes: 28 EXPANDING KNOWLEDGE > 2801 Expanding knowledge > 280110 Expanding knowledge in engineering @ 100%
More Statistics

Actions (Repository Staff Only)

Item Control Page Item Control Page