Global repair bandwidth cost optimization of generalized regenerating codes in clustered distributed storage systems
Gu, Shushi, Wang, Fugang, Zhang, Qinyu, Huang, Tao, and Xiang, Wei (2021) Global repair bandwidth cost optimization of generalized regenerating codes in clustered distributed storage systems. IET Communications, 15 (19). pp. 2469-2481.
|
PDF (Published Version)
- Published Version
Available under License Creative Commons Attribution Non-commercial No Derivatives. Download (1MB) | Preview |
Abstract
In clustered distributed storage systems (CDSSs), one of the main design goals is minimizing the transmission cost during the failed storage nodes repairing. Generalized regenerating codes (GRCs) are proposed to balance the intra-cluster repair bandwidth and the inter-cluster repair bandwidth for guaranteeing data availability. The trade-off performance of GRCs illustrates that, it can reduce storage overhead and inter-cluster repair bandwidths simultaneously. However, in practical big data storage scenarios, GRCs cannot give an effective solution to handle the heterogeneity of bandwidth costs among different clusters for node failures recovery. This paper proposes an asymmetric bandwidth allocation strategy (ABAS) of GRCs for the inter-cluster repair in heterogeneous CDSSs. Furthermore, an upper bound of the achievable capacity of ABAS is derived based on the information flow graph (IFG), and the constraints of storage capacity and intra-cluster repair bandwidth are also elaborated. Then, a metric termed global repair bandwidth cost (GRBC), which can be minimized regarding of the inter-cluster repair bandwidths by solving a linear programming problem, is defined. The numerical results demonstrate that, maintaining the same data availability and storage overhead, the proposed ABAS of GRCs can effectively reduce the GRBC compared to the traditional symmetric bandwidth allocation schemes.
| Item ID: | 70817 |
|---|---|
| Item Type: | Article (Research - C1) |
| ISSN: | 1751-8636 |
| Keywords: | distributed storage systems; repairing; big data storage; asymmetric bandwidth allocation strategy; regenerating codes; |
| Copyright Information: | © 2021 The Authors. This is an open-access article under the terms of the Creative Commons Attribution-NonCommercial-NoDerivs License, which permits use and distribution in any medium, provided the original work is properly cited, the use is non-commercial and no modifications or adaptations are made. |
| Date Deposited: | 24 Nov 2021 01:24 |
| FoR Codes: | 40 ENGINEERING > 4006 Communications engineering > 400608 Wireless communication systems and technologies (incl. microwave and millimetrewave) @ 50% 46 INFORMATION AND COMPUTING SCIENCES > 4606 Distributed computing and systems software > 460601 Cloud computing @ 50% |
| SEO Codes: | 22 INFORMATION AND COMMUNICATION SERVICES > 2201 Communication technologies, systems and services > 220105 Network systems and services @ 50% 22 INFORMATION AND COMMUNICATION SERVICES > 2203 Information services > 220302 Electronic information storage and retrieval services @ 50% |
| Downloads: |
Total: 681 Last 12 Months: 101 |
| More Statistics |
Actions (Repository Staff Only)
 |
Item Control Page |