A method for determining data rollback period in distributed storage system
A distributed storage and data rollback technology, applied in the field of data processing, can solve problems such as difficult to determine the exact time period of data loss, manual processing difficult to respond in a timely manner, etc.
Active Publication Date: 2020-12-25
SHANGHAI YITU NETWORK SCI & TECH
View PDF6 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
[0004] However, when a data rollback occurs in a distributed storage system, it generally only makes a backup of the lost data, triggers an alarm, and waits for manual processing.
However, manual processing is difficult to respond in a timely manner, and it is not easy to determine the exact time period of data loss
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0046] It will be appreciated that, as used herein, the term "module" may refer to or include an Application Specific Integrated Circuit (ASIC), an electronic circuit, a processor (shared, dedicated, or group) that executes one or more software or firmware programs, and and / or memory, combinational logic, and / or other suitable hardware components that provide the described functionality, or may be part of such hardware components.
[0047] It can be understood that, in each embodiment of the present application, the processor may be a microprocessor, a digital signal processor, a microcontroller, etc., and / or any combination thereof. According to another aspect, the processor may be a single-core processor, a multi-core processor, etc., and / or any combination thereof.
[0048] Embodiments of the present application will be further described in detail below in conjunction with the accompanying drawings.
[0049] The embodiment of the present invention uses a persistence mechan...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The present application relates to the field of data processing, and relates to a method, device, machine-readable medium and system for determining a data rollback period in a distributed storage system. The method includes: periodically monitoring the persistent operation of the system and generating monitoring records, The system includes multiple nodes, and the monitoring records include the node name of the master node that performs the persistence operation in the system, the completion time of the persistence operation, and the election time of the master node. The election time is used to record the time when the node was elected as the master node; compare the monitoring time Node names in two adjacent monitoring records; get the difference between the monitoring time in the monitoring record with the later monitoring time and the completion time of the persistence operation in the monitoring record with the earlier monitoring time among the two adjacent monitoring records The time period between is used as the data rollback period or the time period between the election time and the completion time of the persistence operation is used as the data rollback period. This method can accurately obtain the time period of data loss.
Description
technical field [0001] The present application relates to the field of data processing, and in particular to a method, device, machine-readable medium and system for determining a data rollback period in a distributed storage system. Background technique [0002] With the rapid development of cloud computing and big data, the data is growing explosively. Simply increasing the number of hard disks to expand the storage capacity of the computer file system has been unable to meet the exponentially growing data storage requirements in the era of information explosion. A storage system is born from this. [0003] A distributed storage system is a physical storage resource managed by a storage system based on the client / server model. It is connected to nodes through a computer network and can effectively solve data storage and management problems. Extend a storage system fixed at a certain location to any number of locations / multiple storage systems, and a large number of nodes ...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Patents(China)
IPC IPC(8): G06F3/06
CPCG06F3/0619G06F3/0653G06F3/067
Inventor 刘明伟吴永军江旭楷陈萌辉
Owner SHANGHAI YITU NETWORK SCI & TECH