Data processing method, distributed database system, electronic equipment and storage medium

A data processing and database technology, applied in the computer field, can solve problems such as poor practicability and data service interruption, and achieve the effect of solving abnormal data processing problems

Active Publication Date: 2021-11-16
ALIBABA CLOUD COMPUTING LTD +1
View PDF6 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, in this way, due to the prohibition of writing to DML, the data service will be interrupted, and the implementability is poor

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method, distributed database system, electronic equipment and storage medium
  • Data processing method, distributed database system, electronic equipment and storage medium
  • Data processing method, distributed database system, electronic equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0034] refer to Figure 3A , shows a flowchart of steps of a data processing method according to Embodiment 1 of the present application.

[0035] The data processing method of this embodiment is described from the perspective of fragmentation nodes in a distributed database system, and the data processing method includes the following steps:

[0036] Step S202: Receive physical DDL instructions converted from logical DDL instructions for changing data in the distributed database system.

[0037] As mentioned above, although the data in the distributed database system may actually be distributed on multiple physical nodes or multiple shard nodes, it is presented to the user in the form of "single database and single table". The corresponding "single table", that is, the logical table presented to the user, performs corresponding operations, such as performing DDL changes on the data table, etc. This kind of DDL operation for the logical table will generate logical DDL instruc...

Embodiment 2

[0057] refer to Figure 4A , shows a flowchart of steps of a data processing method according to Embodiment 2 of the present application.

[0058] The data processing method of this embodiment is still described from the perspective of fragmentation nodes in the distributed database system, and the data processing method includes the following steps:

[0059] Step S302: Receive physical DDL instructions converted from logical DDL instructions for changing data in the distributed database system.

[0060] For example, in a distributed MySQL-SHARDING database system, DDL instructions acting on logical database tables are logical DDL instructions, and DDL instructions acting on physical database tables are physical DDL instructions. Through the logic DDL instruction, functions such as adding data columns to the data table, changing the type and length of the data columns, and adding constraints to the data columns can be realized. The specific conversion method of converting lo...

Embodiment 3

[0076] refer to Figure 5 , shows a flow chart of steps of a data processing method according to Embodiment 3 of the present application.

[0077] The data processing method of this embodiment is described from the perspective of a middleware node in a distributed database system, and the data processing method includes the following steps:

[0078] Step S402: Receive a logical DDL instruction for changing data in the distributed database system, and convert the logical DDL instruction into a physical DDL instruction.

[0079] As mentioned above, the user issues a DDL instruction based on the presented global logic table, that is, a logical DDL instruction, which needs to be converted into a physical DDL instruction executable by the actual sharding node.

[0080] Step S404: Send the physical DDL instruction to the corresponding shard node, so that the shard node executes the physical DDL instruction, and after the physical DDL instruction is successfully executed, obtain Ac...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention provides a data processing method, a distributed database system, electronic equipment and a computer storage medium. The data processing method is applied to fragment nodes in the distributed database system. The method comprises the following steps: receiving a physical DDL instruction converted from a logic DDL instruction for changing data in the distributed database system; executing the physical DDL instruction, and after the physical DDL instruction is successfully executed, generating a fragment node mode snapshot for the fragment node; and if it is determined that the fragment node mode snapshot is inconsistent with the global logic mode snapshot of the distributed database system, adjusting log data of the fragment node converged into a global log to be consistent with the global logic mode snapshot. Through the embodiment of the invention, the problem of data processing exception caused by multiple data versions in the DDL change process of the distributed database system is effectively solved.

Description

technical field [0001] The embodiments of the present application relate to the technical field of computers, and in particular, to a data processing method, a distributed database system, an electronic device, and a computer storage medium. Background technique [0002] A distributed database refers to a group of databases that are distributed on a computer network and are logically interrelated. With the continuous development of database technology, more and more distributed databases adopt the form of fragmentation. In this form, the storage unit of data in the distributed database is divided into fragments, and the division of the global database is called fragmentation. [0003] In the distributed data in the form of fragmentation, such as the MYSQL-SHARDING type distributed database, this type of distributed data implements the global Binlog based on TSO, which can ensure the integrity and global order of transactions during data replication. Among them, TSO (Timest...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/21G06F16/23G06F16/27
CPCG06F16/219G06F16/2322G06F16/27
Inventor 卢彪林延峰吴学强邓由由
Owner ALIBABA CLOUD COMPUTING LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap