Failover method and device of HBase system

A technology of failover and failure, which is applied in the field of computer communication, can solve the problem of updating data loss and other problems, and achieve the effect of avoiding loss

Active Publication Date: 2019-12-03
BEIJING XIAOMI MOBILE SOFTWARE CO LTD
View PDF14 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] When a working node fails, if the amount of data in the memory of the working node does not reach the preset value, the updated data in the memory is not written to the hard disk, and the updated data in the memory is lost.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Failover method and device of HBase system
  • Failover method and device of HBase system
  • Failover method and device of HBase system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0056] Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numerals in different drawings refer to the same or similar elements unless otherwise indicated. The implementations described in the following exemplary examples do not represent all implementations consistent with the present disclosure. Rather, they are merely examples of apparatuses and methods consistent with aspects of the present disclosure as recited in the appended claims.

[0057] The terminology used in the present disclosure is for the purpose of describing particular embodiments only, and is not intended to limit the present disclosure. As used in this disclosure and the appended claims, the singular forms "a", "the", and "the" are intended to include the plural forms as well, unless the context clearly dictates otherwise. It should also be understood t...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a failover method and a failover device of an HBase system. The method is applied to a first working node in an HBase system. The method comprises the following steps of obtaining a pre-writing log system WAL file sent by a management node in an HBase system, wherein the WAL file comprises: a WAL file; when a second working node in the HBase system breaks down, the WAL filesof a plurality of table fragments are arranged in the second working node; splitting a WAL file in a self node memory; obtaining a WAL file of each table fragment; according to the WAL file of each table fragment in the own node memory, obtaining the WAL file; and determining update data of each table fragment in the memory of the second working node when a fault occurs, and writing the update data of each table fragment into the own node hard disk, thereby realizing transfer and persistent storage of the update data of the table fragments in the memory of the second working node, and avoiding loss of the data in the memory when the second working node has the fault.

Description

technical field [0001] The present disclosure relates to the technical field of computer communication, in particular to a failover method and device for an HBase system. Background technique [0002] HBase is an open source distributed database. The services provided are deployed on multiple nodes, and multiple nodes form a distributed cluster, which is also called the HBase system. Based on the different types of services provided, the HBase system includes: management nodes and work nodes. The management nodes are used to manage the table fragmentation information of the work nodes, and the work nodes are used to receive read and write requests sent by the The write request modifies the table data of the table fragment. [0003] After the working node receives the read and write request sent by the requesting end, it modifies the table data of the table fragment in the memory according to the read and write request to obtain the updated data. When the amount of data in t...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F11/07G06F11/14G06F16/25G06F16/27
CPCG06F11/0709G06F11/1448G06F16/258G06F16/27G06F11/2025G06F11/2028G06F11/2041G06F11/1658G06F2201/80Y02D10/00G06F16/2365G06F11/1451
Inventor 张洸豪张铎
Owner BEIJING XIAOMI MOBILE SOFTWARE CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products