Attention Mechanism-Aided Deep Reinforcement Learning for Dynamic Edge Caching
Teng, Ziyi, Fang, Juan, Yang, Huijing, Yu, Lu, Chen, Huijie, and Xiang, Wei (2024) Attention Mechanism-Aided Deep Reinforcement Learning for Dynamic Edge Caching. IEEE Internet of Things Journal, 11 (6). pp. 10197-10213.
|
PDF (Publisher Accepted Version)
- Published Version
Available under License Creative Commons Attribution Non-commercial No Derivatives. Download (2MB) | Preview |
Abstract
The dynamic mechanism of joint proactive caching and cache replacement, which involves placing content items close to cache-enabled edge devices ahead of time until they are requested, is a promising technique for enhancing traffic offloading and relieving heavy network loads. However, due to limited edge cache capacity and wireless transmission resources, accurately predicting users’ future requests and performing dynamic caching is crucial to effectively utilizing these limited resources. This paper investigates joint proactive caching and cache replacement strategies in a general mobile edge computing (MEC) network with multiple users under a cloud-edge-device collaboration architecture. The joint optimization problem is formulated as a markov decision process (MDP) problem with an infinite range of average network load costs, aiming to reduce network load traffic while efficiently utilizing the limited available transport resources. To address this issue, we design an Attention Weighted Deep Deterministic Policy Gradient (AWD2PG) model, which uses attention weights to allocate the number of channels from server to user, and applies deep deterministic policies on both user and server sides for Cache decision-making, so as to achieve the purpose of reducing network traffic load and improving network and cache resource utilization. We verify the convergence of the corresponding algorithms and demonstrate the effectiveness of the proposed AWD2PG strategy and benchmark in reducing network load and improving hit rate.
Item ID: | 81256 |
---|---|
Item Type: | Article (Research - C1) |
ISSN: | 2327-4662 |
Keywords: | attention-weighted channel assignment, deep reinforcement learning, edge caching, Internet of Things, Load modeling, Optimization, Resource management, Servers, Telecommunication traffic, Wireless communication, Wireless network |
Copyright Information: | This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 License. |
Date Deposited: | 08 Mar 2024 04:54 |
FoR Codes: | 40 ENGINEERING > 4006 Communications engineering > 400608 Wireless communication systems and technologies (incl. microwave and millimetrewave) @ 100% |
SEO Codes: | 22 INFORMATION AND COMMUNICATION SERVICES > 2204 Information systems, technologies and services > 220404 Computer systems @ 100% |
Downloads: |
Total: 41 Last 12 Months: 6 |
More Statistics |