Data processing method and system, computer equipment and storage medium

A data processing and data technology, applied in the field of data processing, can solve problems such as data loss, abnormal online processing nodes, lack of disaster recovery and high availability, and achieve high availability and strong consistency

Pending Publication Date: 2020-07-03
GUANGDONG XIAOTIANCAI TECH CO LTD
View PDF7 Cites 14 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The distributed message storage system adopts the master-slave mode architecture, and its disadvantages are: 1. It lacks disaster recovery and high availability, and cannot automatically control node switching. Once a problem occurs, human intervention and manual switching are required, which requires operation and maintenance personnel to be online at all times Handling node exceptions
2. Data integrity cannot be guaranteed, and there is a possibility of data loss in the master-slave mode

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method and system, computer equipment and storage medium
  • Data processing method and system, computer equipment and storage medium
  • Data processing method and system, computer equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0024] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the specific implementation manners of the present invention will be described below with reference to the accompanying drawings. Obviously, the accompanying drawings in the following description are only some embodiments of the present invention, and those skilled in the art can obtain other accompanying drawings based on these drawings and obtain other implementations.

[0025] In order to make the drawing concise, each drawing only schematically shows the parts related to the present invention, and they do not represent the actual structure of the product. In addition, to make the drawings concise and easy to understand, in some drawings, only one of the components having the same structure or function is schematically shown, or only one of them is marked. Herein, "a" not only means "only one", but also means "more than one".

[0026] Reference ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a data processing method and system, computer equipment and a storage medium, and the method comprises the steps that a main node in a Dedger cluster processes a writing requestafter receiving the writing request transmitted by a client, and obtains log data; the master node broadcasts the log data to all slave nodes in the cluster; and the master node feeds back the user side according to the storage condition of the log data by the slave node. The distributed message storage multi-copy mechanism can be realized based on the raft algorithm, and the advantages of strongconsistency, high reliability, high availability and the like of message storage can be well realized.

Description

technical field [0001] The present invention relates to the technical field of data processing, in particular to a data processing method, system, computer equipment and storage medium. Background technique [0002] Since the emergence of distributed systems, system disaster recovery and consistency have become frequently discussed topics. The distributed message storage system adopts the master-slave mode architecture, and its disadvantages are: 1. It lacks disaster recovery and high availability, and cannot automatically control node switching. Once a problem occurs, human intervention and manual switching are required, which requires operation and maintenance personnel to be online at all times Handle node exceptions. 2. Data integrity cannot be guaranteed, and there is a possibility of data loss in the master-slave mode. Contents of the invention [0003] The purpose of the present invention is to provide a data processing method, system, computer equipment and stora...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/27G06F16/23
CPCG06F16/27G06F16/2365
Inventor 王一超
Owner GUANGDONG XIAOTIANCAI TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products