Data processing method and device, electronic equipment and computer storage medium

A data processing and data backup technology, applied in the computer field, can solve the problems of large user business intrusion, affecting user use, and the database cannot provide data writing services, so as to minimize user business impact, ensure database backup, and ensure global consistency. sexual effect

Pending Publication Date: 2021-02-02
ALIBABA GRP HLDG LTD
View PDF0 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Although this method ensures global data consistency, it has a large intrusion into user business, and

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method and device, electronic equipment and computer storage medium
  • Data processing method and device, electronic equipment and computer storage medium
  • Data processing method and device, electronic equipment and computer storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0034] refer to figure 1 , shows a flowchart of steps of a data processing method according to Embodiment 1 of the present invention.

[0035] The data processing method of the present embodiment includes the following steps:

[0036] Step S102: Receive a backup request for the distributed database, and instruct each corresponding database instance to perform full data backup according to the backup request.

[0037] In this embodiment, the distributed database can adopt database sub-table technology (such as MySQL Sharding). This kind of distributed database can split a data table with a large amount of data into multiple sub-tables, and these sub-table Distributed across multiple database instances (such as MySQL instances). In this way, the sub-tables in each MySQL instance only contain part of the data in the data table, so that the data storage and computing pressure is distributed among multiple MySQL instances to solve the problem of single-machine performance bottlen...

Embodiment 2

[0058] refer to image 3 , shows a flowchart of steps of a data processing method according to Embodiment 2 of the present invention.

[0059] The data processing method of this embodiment includes the aforementioned steps S102 to S108.

[0060] Wherein, the step S104 includes the following sub-steps:

[0061] Sub-step S1041: After determining that each database instance completes the full data backup, determine whether all the distributed transactions that are being executed across database instances are committed.

[0062] Since the submission of distributed transactions may cause the global consistency of data cannot be guaranteed, in order to avoid this problem, after confirming that each database instance has completed the full data backup and before locking the distributed transactions, determine whether all the distributed transactions in execution Commit complete.

[0063] It should be noted that the completion of submission in this embodiment can be either a formal...

Embodiment 3

[0072] refer to Figure 4 , shows a flowchart of steps of a data processing method according to Embodiment 3 of the present invention.

[0073] The data processing method of this embodiment includes the aforementioned steps S102 to S108.

[0074] The step S104 can be realized by the method in the foregoing embodiment 1 or embodiment 2, or by other methods.

[0075] In this embodiment, the step S108 includes the following sub-steps:

[0076] Sub-step S1081: Generate an unlock instruction that allows the distributed transaction to be committed, to indicate to unlock the distributed transaction.

[0077] In order to minimize the intrusion to the user's business, after obtaining the information of the log file, an unlock command that allows distributed transaction submission is generated, so that the user business can normally submit the distributed transaction.

[0078] Those skilled in the art may use any appropriate method to generate the unlock instruction as required, whic...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention provides a data processing method and device, electronic equipment and a computer storage medium. The data processing method comprises the following steps: receiving abackup request for a distributed database, and indicating each corresponding database instance to carry out full data backup according to the backup request; after determining that all the database instances complete the full-amount data backup, locking distributed transactions used for cross-database-instance data updating; acquiring information of a log file recording incremental data of each database instance in a set time period; and unlocking the distributed transaction, and generating a data backup set of the distributed database according to the backup result of each database instance and the information of the log file. The data processing method can minimize intrusion into the user service when backing up the database.

Description

technical field [0001] The embodiments of the present invention relate to the field of computer technology, and in particular, to a data processing method, device, electronic equipment, and computer storage medium. Background technique [0002] Database backup and recovery is an important guarantee for user data security, and as the scale of user business increases, the amount of data stored in the database and the storage load also increase exponentially. In order to improve the performance of the stand-alone database, a database sharding (MySQL Sharding) technology is provided. [0003] Database sub-database and sub-table technology is a technology that splits and stores databases and / or data tables according to the sub-database and sub-table algorithm. In the scenario of distributed database with sub-database and sub-table, database backup and recovery operations is even more important. [0004] Currently, there are two main data backup and recovery schemes for distribu...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F11/14G06F16/23G06F16/27
CPCG06F11/1448G06F16/2365G06F16/27G06F16/23G06F11/14
Inventor 吴迪郭鹏楼江航
Owner ALIBABA GRP HLDG LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap