Data recovery method, device and medium for distributed file system cluster node
A distributed file and recovery method technology, applied in the field of data processing, can solve the problems of stuck reading and writing operations, large data volume, and large bandwidth occupation, and achieve the effects of improving stability, reducing impact, and avoiding occupation
Active Publication Date: 2019-01-15
LANGCHAO ELECTRONIC INFORMATION IND CO LTD
View PDF20 Cites 10 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
When the number of faulty OSDs in the cluster nodes is large, the amount of data to be restored is large when data recovery is performed for these faulty OSDs. In this case, since the cluster bandwidth is fixed, the process of data recovery will Occupies a large amount of bandwidth, thereby reducing the bandwidth that can be used by the read and write operations of the front-end business, causing the read and write operations to freeze, and even causing the entire distributed file system to crash
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0042] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.
[0043] The core of the embodiment of the present invention is to provide a data recovery method for a distributed file system cluster node, which can reduce the impact of the data recovery operation of the cluster node on the distributed file system and improve the stability of the system; another core of the present invention is A data recovery device and a computer-readable storage medium for distributed file system cluster nodes are provided, both of which h...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention discloses a data recovery method of a cluster node of a distributed file system, which comprises the following steps: when a cluster node fails, obtaining a failed OSD in the cluster node; judging whether the ratio of the number of faulty OSDs to the total number of OSDs in the cluster node is greater than or equal to a preset threshold; if greater than or equal to, the fault state of the faulty OSD is maintained. Compared with the prior art, when the fault OSD is judged, the data recovery operation is carried out for the fault OSD according to the preset rules, and when a largenumber of fault OSDs exist, the amount of data to be recovered is large, thereby affecting the read and write operation of the front-end service. The method avoids that the data recovery operation occupies a large amount of bandwidth, thereby reducing the influence on the data reading and writing operation, thus improving the stability of the distributed file system. The invention also discloses acomputer-readable storage medium of a data recovery device of a distributed file system cluster node, which has the above-mentioned beneficial effects.
Description
technical field [0001] The invention relates to the field of data processing, in particular to a data recovery method, device and computer-readable storage medium for cluster nodes of a distributed file system. Background technique [0002] In recent years, a Distributed File System (DFS, Distributed File System) has been more and more widely used because it can realize centralized management of file sharing. In the process of running the distributed file system, cluster nodes will inevitably fail. In the prior art, when a cluster node of the distributed file system fails, if the cluster node does not resume normal operation within a preset time, the faulty OSD (Object-basedStorage Device, object storage device) in the cluster node is Set it to the out state and trigger the process of data recovery, so that these faulty OSDs can be added to the cluster after data recovery. When the number of faulty OSDs in the cluster nodes is large, the amount of data to be restored is la...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Applications(China)
IPC IPC(8): G06F11/14
CPCG06F11/1435
Inventor 李彦博
Owner LANGCHAO ELECTRONIC INFORMATION IND CO LTD