Method for disaster recovery and playback of computing node data, terminal equipment and storage medium

A computing node and data disaster recovery technology, applied in the field of data processing, can solve the problems of low playback efficiency and unsatisfactory recovery timeliness, and achieve the effect of solving the timeliness problem

Active Publication Date: 2019-07-16
XIAMEN YAXON NETWORKS CO LTD
View PDF6 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Although this method ensures the high availability of computing node data, when writing records to disk files, because they are written to a disk file uniformly, there will inevitably be I/O performance problems of concurrent writing. In addition, when In an abnormal situation, when it is necessary to restore the data of the computing node, it is necessary to perform "full playback", that is, to load all the records in t

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for disaster recovery and playback of computing node data, terminal equipment and storage medium
  • Method for disaster recovery and playback of computing node data, terminal equipment and storage medium
  • Method for disaster recovery and playback of computing node data, terminal equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0026] Example one:

[0027] See Figure 1-Figure 4 As shown, the present invention provides a method for computing node data disaster recovery playback. The basic principle is: first implement a master-slave backup strategy for the data queue of the computing node, and use multi-threading while inserting the data body into the main queue. Parallel operation of disks will persist the enqueue information of the data to the corresponding WAL log file under the disk directory of the WAL log file set in the process of setting the disk directory (WAL log files are divided according to the size, and the file ID is distinguished), and then a separate slave queue is cached in the memory of the computing node, and the file ID of the WAL log file corresponding to each piece of data to be processed and the offset address of the stored disk file are recorded. Since the main queue caches the real data body, and the slave queue caches the file ID of the WAL log file and the offset address of t...

Example Embodiment

[0042] Embodiment two:

[0043] The present invention also provides a terminal device for computing node data disaster recovery playback, including a memory, a processor, and a computer program stored in the memory and running on the processor, and the processor executes the computer program When implementing the process in the foregoing method embodiment of the embodiment of the present invention, for example Figure 1-Figure 4 The method process of the process shown.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method for disaster recovery and playback of computing node data. The method comprises the following processes: a process of setting a disk directory, a process of setting backup frequency of check point files, a process of enabling data to enter computing nodes, a process of processing the data by the computing nodes, and a process of data playback when the computing nodes are abnormal. A terminal device for disaster recovery and playback of computing node data comprises a memory, a processor and a computer program which is stored in the memory and can run on the processor, and the processor implements the method for disaster recovery and playback of the computing node data when executing the computer program. A computer readable storage medium stores a computerprogram, and when the computer program is executed by a processor, the steps of the method for disaster recovery and playback of computing node data are achieved. Not only is the high-performance datadisaster recovery problem of the computing node realized, but also the aging problem of data recovery and playback is solved.

Description

technical field [0001] The invention relates to the technical field of data processing, in particular to a method for computing node data disaster recovery playback, a terminal device and a storage medium. Background technique [0002] With the advent of the era of massive data, data computing power and data disaster recovery have become indispensable indicators in software system architecture. As for the computing power of data, the horizontal expansion of computing nodes can be realized by means of distributed load balancing at the system architecture level, so as to achieve unlimited improvement of computing power. However, how to ensure data disaster recovery and playback on each computing node has also become the focus of the industry. [0003] Most of the data disaster recovery on traditional computing nodes is to use WAL (write-ahead-log) for the data cached in the queue, that is, to record a log into a disk file before inserting the data into the queue. Persist to ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/18G06F16/13G06F11/14
CPCG06F11/1448G06F16/13G06F16/1815
Inventor 游锋锋陈福林曾夺杨俊辉
Owner XIAMEN YAXON NETWORKS CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap