Unlock instant, AI-driven research and patent intelligence for your innovation.

Data processing method and device and electronic equipment

A database and new data technology, applied in the computer field, can solve problems such as limiting the number of unique keys, unique key field selection, etc., and achieve the effect of increasing flexibility

Active Publication Date: 2020-03-10
ALIBABA CLOUD COMPUTING LTD
View PDF8 Cites 9 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The way to realize the unique key in the prior art requires that the field used as the unique key (referred to as the unique key field) should be the same as the partition key field, which greatly limits the number of unique keys and the selection of the unique key field

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method and device and electronic equipment
  • Data processing method and device and electronic equipment
  • Data processing method and device and electronic equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0060] like image 3 As shown, it is one of the schematic flowcharts of the data processing method according to the embodiment of the present invention. The data processing method of this embodiment is applied to a distributed database system. The distributed database system includes a distributed database engine and multiple data nodes. Multiple partitioned databases are set on the data nodes, and partitions are set on the distributed data engine. Key routing table and unique key index routing table. Among them, in the distributed database system, each data node may exist in the form of an instance, and each partition database may be a Schema (data object set) in each instance. specifically, image 3 The illustrated method is executed on a distributed data engine and includes:

[0061] S101: Query the partition key routing table according to the value of the partition key field in the new data to be inserted, and determine the first routing information of the first destina...

Embodiment 2

[0075] like Figure 5 As shown, it is the third schematic flowchart of the data processing method according to the embodiment of the present invention. In the first embodiment, the processing performed by the distributed database engine is introduced, and in this embodiment, the processing procedure of the data node will be further introduced. like Figure 5 As shown, after the distributed database engine sends the data insertion request message to a data node, the data node performs the following processing:

[0076] S301: Receive a data insertion request message sent by a distributed database engine. As described in the foregoing embodiment, the data insertion request message includes the new data to be inserted, the first routing information of the first destination partition database where the data table slice corresponding to the new data is located, and the unique key index table slice corresponding to the new data. The second routing information of the second destina...

Embodiment 3

[0091] like Figure 7 As shown, it is one of the schematic structural diagrams of the data processing device according to the embodiment of the present invention. The device is applied to a distributed database system. The distributed database system includes a distributed database engine and a plurality of data nodes. The data nodes are provided with A plurality of partitioned databases are provided with a partition key routing table and a unique key index routing table in the distributed data engine, and the device is set in the distributed data engine, which includes:

[0092] The first routing information generation module 11 is used to query the partition key routing table according to the value of the partition key field in the new data to be inserted, and determine the first route of the first destination partition database where the data table slice corresponding to the new data is located information.

[0093] The second routing information generating module 12 is co...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the invention provides a data processing method and device and electronic equipment. The method comprises the following steps: querying a partition key routing table according to thevalue of a partition key field in to-be-inserted new data, and determining first routing information; querying a unique key index routing table according to the value of the unique key field, and determining second routing information; and packaging the new data, the first routing information and the second routing information into a data insertion request message, and sending the data insertionrequest message to a data node. According to the embodiment of the invention, the unique key index routing table is additionally arranged in the distributed database engine, and the storage space of the unique key index table slice is additionally arranged in each partition database; the unique key is realized independent of the partition key, so that the limitation that only the partition key canbe used as the unique key in the prior art is broken through, and the flexibility of setting and using the unique key is improved.

Description

technical field [0001] The present application relates to a data processing method, device and electronic device, and belongs to the technical field of computers. Background technique [0002] In a distributed database system, multiple pieces of data in a data table in a single machine can be partitioned and stored according to certain partition rules through partition keys, that is, the data table is divided into multiple data table slices according to certain partition rules. When new data needs to be inserted into the distributed database, the distributed database engine will first query the partition key routing table according to the field contained in the data as the partition key (referred to as the partition key field) to determine the data table corresponding to the piece of data The slice is located in the partition database (referred to as the destination partition database), and then the piece of data is sent to the data node where the destination partition datab...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/27
CPCY02D10/00
Inventor 朱海涛
Owner ALIBABA CLOUD COMPUTING LTD