Switching method and system for big data software system, terminal equipment and storage medium

A software system and big data technology, which is applied in the fields of electrical digital data processing, special data processing applications, and redundancy in operations for error detection of data, which can solve problems such as unavailability of software systems.

Active Publication Date: 2018-11-02
中移动信息技术有限公司
View PDF5 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] The main purpose of the present invention is to provide a big data software system switching method, system, terminal equipment and storage medium, aiming to solve the problem that the Hadoop-based big data sof...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Switching method and system for big data software system, terminal equipment and storage medium
  • Switching method and system for big data software system, terminal equipment and storage medium
  • Switching method and system for big data software system, terminal equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0045] It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

[0046] The solution of the embodiment of the present invention is mainly: the present invention saves the offset of the first Kafka component of the main Hadoop cluster to the first Redis component of the main Hadoop cluster when receiving the master-standby switching instruction through the terminal device; Synchronize the open source data of the first HBase component of the main Hadoop cluster to the second HBase component of the standby Hadoop cluster, and synchronize the storage data of the first Redis component comprising the offset to the second HBase component of the standby Hadoop cluster. Redis component; The open source data of described main Hadoop cluster and the collection of stored data are used as the main data of described main Hadoop cluster, and the collection of open source data and stored data after...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a switching method and system for a big data software system, terminal equipment and a storage medium. When the terminal equipment receives a master-slave switching instruction, an offset of a first Kafka component of a master Hadoop cluster is stored to a first Redis component of the master Hadoop cluster; open source data of a first HBase component of the master Hadoop cluster is synchronized to a second HBase component of a slave Hadoop cluster, storage data of the first Redis component, which comprises the offset, is synchronized to a second Redis component of the slave Hadoop cluster; and when master data of the master Hadoop cluster and slave data of the slave Hadoop cluster are consistent, a switching operation from a master production system to a slave production system is carried out. Availability of the integral software system is greatly promoted, guarantee capacity of a real-time service is reinforced, and a problem of poor reliability of a single cluster is avoided.

Description

technical field [0001] The present invention relates to the field of computer applications, in particular to a big data software system switching method, system, terminal equipment and storage medium. Background technique [0002] In a big data software system that uses the distributed system infrastructure Hadoop, it usually relies on the high availability of each component of Hadoop itself. For example, the distributed, column-oriented open source database HBase used divides the created table control table into multiple response module HRegions in the row direction, and each response module Hregion is dispersed in different response service components through a multi-data copy mechanism. RegionServer comes up to ensure the high availability of HBase itself. Larger Internet companies or financial institutions such as banks will establish remote data centers to ensure data security, but they usually use mature database management systems such as relational database manageme...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30G06F11/14
CPCG06F11/1415
Inventor 陈吉
Owner 中移动信息技术有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap