Adaptive data recovery flow control method, device, electronic equipment and storage medium

An adaptive, data-based technology, applied in the computer field, can solve problems such as high probability of failure, achieve good flow control effect, ensure IO load, and reduce the effect of failure recovery intensity
CN108804039BActive Publication Date: 2021-01-29PING AN TECH (SHENZHEN) CO LTD
4 Cites 0 Cited by

Patent Information

Authority / Receiving Office
CN Β· China
Patent Type
Patents(China)
Current Assignee / Owner
PING AN TECH (SHENZHEN) CO LTD
Publication Date
2021-01-29

Smart Images

  • Figure 1
    Figure 1
  • Figure 2
    Figure 2
  • Figure 3
    Figure 3
Patent Text Reader

Abstract

An adaptive data recovery flow control method, including: regularly synchronizing information of each storage node in a distributed storage system; when detecting that a storage node has failed, obtaining a storage list of the failed storage node; identifying The IO load category of the user application in the last statistical period; calculate the flow control threshold corresponding to the current statistical period according to the IO load category in the previous statistical period; according to the storage list and the flow control threshold corresponding to the current statistical period , perform a recovery operation on the data in the current statistical period of the failed storage node; repeat the above steps until all the data is recovered. The invention also provides an adaptive data restoration flow control device, electronic equipment and storage medium. The present invention can improve the data repair efficiency of a large-scale distributed storage system and reduce the risk of data loss, while avoiding obvious impact on normal input and output service performance, and has a good flow control effect.
Need to check novelty before this filing date? Find Prior Art

Description

technical field

[0001] The invention relates to the field of computer technology, in particular to an adaptive data recovery flow control method, device, electronic equipment and storage medium. Background technique

[0002] With the advent of the era of big data and cloud computing, the amount of data in various fields is showing a trend of rapid growth. These ever-growing massive data need to rely on large-scale distributed storage systems to achieve reliable storage and efficient access. However, the larger the storage system, the higher the probability of failure. In order to cope with possible failures at any time and ensure the reliability of data storage, distributed storage systems need data redundancy. A common data redundancy strategy is to store multiple copies of data on different physical nodes. When some copies are damaged, the damaged copies can be repaired based on the intact copies.

[0003] In addition, when expanding the capacity of a distributed storag...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More