Data processing method and system and equipment

A data processing and data technology, which is applied in the computer field, can solve the problems of data idle state and difficult to meet the data processing requirements of the database

Pending Publication Date: 2022-01-28
ALIBABA CLOUD COMPUTING LTD +1
View PDF0 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In normal operation, when the coordinating node receives a data read request or a data write request, it is completed by the master node in the corresponding computing unit, and the standby node in the computing unit will not participate in the data reading and writing work. Therefore, the standby node Altho

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method and system and equipment
  • Data processing method and system and equipment
  • Data processing method and system and equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0036] In a distributed database, there are coordinating nodes and computing units. The task scheduling for each computing unit (segment) is realized through the coordinating node (master). Generally speaking, in order to ensure the reliability and stability of the operation of the computing unit, each computing unit includes not only the primary node (primary), but also at least one backup node (mirror). However, the function of the backup node is that in the case of failure of the master node, the backup node will replace the master node to work. If the master node is working normally, the standby node will be updated according to the data update of the master node. Especially when the number of computing units is large, the cost of data backup is relatively high, but the utilization rate of the standby node is very low, resulting in waste of storage resources.

[0037] figure 1 It is a schematic diagram of the overall structure of a data processing system provided in the...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention provides a data processing method and system and device. The method comprises the following steps: storing main and standby synchronization state information of a plurality of computing units; each computing unit comprises a main node and at least one standby node, and the main and standby synchronization state information comprises a playback log identifier of the standby node; the playback log identifier is determined after the standby node performs data playback by using a master node synchronization log belonging to the same computing unit; a target computing unit is determined from the plurality of computing units according to the log identifier and the main and standby synchronization state information carried in the data processing request. a read request is received, and the read request is sent to at least one standby node in the target computing unit, so that the at least one standby node responds to the read request to feed back corresponding target data. According to the technical scheme provided by the embodiment of the invention, based on the coordination node, the main node and the at least one standby node, a one-write multi-read data processing effect is realized, the strong consistency of data processing is ensured, and the data processing efficiency can be effectively improved.

Description

technical field [0001] The present application relates to the field of computer technology, in particular to data processing methods, systems and equipment. Background technique [0002] With the development of cloud computing technology, the database scale is also increasing. In order to meet the requirements of big data and high-efficiency database application, a distributed database architecture is proposed based on the existing centralized database. [0003] In the existing distributed database, a coordination node has multiple storage nodes and computing units. In order to ensure data safety and reliability, backup data is usually established for each node. For example, in a computing unit, assign at least one standby node for data backup to each primary node. However, only when the data on the standby node is lost or the primary node fails, the standby node can recover the data. In normal operation, when the coordinating node receives a data read request or a data ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/27G06F11/14
CPCG06F16/27G06F11/1448
Inventor 陆元飞陈冰侯文彬魏闯先占超群
Owner ALIBABA CLOUD COMPUTING LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap