Eureka AIR delivers breakthrough ideas for toughest innovation challenges, trusted by R&D personnel around the world.

Data transmission method, device, equipment and storage medium

A data transmission method and secondary data technology, applied in the database field, can solve problems such as difficult batch processing, large memory, and adjustment of the number of records

Pending Publication Date: 2020-10-09
SHANGHAI DAMENG DATABASE
View PDF7 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] Data transmission in units of multiple records can perform batch calculations on expressions, reduce the number of calls to expression functions and the number of jumps between operators, and increase the hit probability of CPU instructions, but it will increase the number of scenarios Lower query response time and consumes more memory
Data transmission by a single record can reduce query response time and reduce memory consumption, but it cannot obtain many benefits brought by batch data processing
[0004] In the prior art, for a database system that uses a single record as the scale of data transmission between operators, it is difficult to perform batch processing of data, and it lacks a kind of Optimization means; for database systems that support the use of multiple records as the scale of data transmission between operators, when receiving high-level commands and calling multiple operators for execution, all operators use the same number of records for data transmission Propagation, and the number of records between different operators cannot be adjusted according to the specific characteristics during execution, and it is difficult to optimize the response time

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data transmission method, device, equipment and storage medium
  • Data transmission method, device, equipment and storage medium
  • Data transmission method, device, equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0049] figure 1 It is a flow chart of a data transmission method provided by Embodiment 1 of the present invention. This embodiment is applicable to data transmission between operators in a database system according to operation instructions. This method can be executed by a data transmission device. The data transmission device may be implemented by software and / or hardware, and the data transmission device may be configured on a computing device, specifically including the following steps:

[0050] S101. Determine at least one operator according to a received operation instruction.

[0051] Wherein, at least one operator forms a tree structure, and each operator is a node in the tree structure. An operator can be understood as an instruction symbol used to represent instruction logic rules, and data transmission between operators can be performed in the form of a single record or multiple records.

[0052] Optionally, operators can be divided into two types according to wh...

Embodiment 2

[0065] figure 2 It is a flowchart of a data transmission method provided by Embodiment 2 of the present invention. The technical solution of this embodiment is further refined on the basis of the above-mentioned technical solution, specifically including the following steps:

[0066] S201. Determine at least one operator according to the received operation instruction, the at least one operator forms a tree structure, and each operator is a node in the tree structure.

[0067] S202. Determine the initial record number of each operator according to the type information of each operator, and determine the initial record number as the set record number.

[0068] Among them, the type information of the operator can be understood as the type of the operator determined according to whether the operator needs to be cached, the positional relationship in the tree structure, and the sub-operator type of the operator. The initial number of records can be understood as the number of r...

Embodiment 3

[0136] image 3 A schematic structural diagram of a data transmission device provided by Embodiment 3 of the present invention, the data transmission device includes: an operator determination module 31 , a record number acquisition module 32 , a record number update module 33 and a data transmission module 34 .

[0137] Wherein, the operator determination module 31 is used to determine at least one operator according to the received operation instruction; the at least one operator forms a tree structure, and each operator is a node in the tree structure; the number of records The obtaining module 32 is used to obtain the actual number of records and the set number of records of each operator after completing a data transmission in the tree structure if the first operator is included in the tree structure; wherein, the The first operator is a filter operator or a connection operator; the record number update module 33 is used to update the set record number according to the ac...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the invention discloses a data transmission method, a device, equipment and a storage medium. The method comprises the following steps: determining at least one operator according toa received operation instruction; wherein at least one operator forms a tree structure, and each operator is a node in the tree structure; if the tree structure comprises the first operator, obtaining the actual record number and the set record number of each operator after one-time data transmission in the tree structure is completed; updating the set number of records according to the actual number of records; and transmitting data in the tree structure according to the updated set record number, and returning to execute the operation of obtaining the actual record number of each operator and the set record number after one-time data transmission in the tree structure until the data corresponding to the operation instruction is transmitted. According to the technical scheme provided bythe embodiment of the invention, the dynamic setting of the number of the operator records during data transmission is realized, the flexibility of setting the number of the operator records is improved, and the response time of the same command is reduced.

Description

technical field [0001] The embodiments of the present invention relate to the technical field of databases, and in particular, to a data transmission method, device, equipment, and storage medium. Background technique [0002] Database Structured Query Language (Structured Query Language, SQL) is a programming language applied to database query, which can be used to store data in the database and to query, update and manage relational database systems. The application of SQL language can enable users to query in high-level data Work on the structure without knowing the specific data storage method, so that the application of the database has greater flexibility and more powerful functions. SQL is usually expressed in the form of a binary tree of operators in the execution plan, and the data between operators is transmitted in the form of a single record or multiple records. [0003] Data transmission in units of multiple records can perform batch calculations on expressions...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F16/28G06F16/22G06F16/23
CPCG06F16/283G06F16/2246G06F16/2386
Inventor 宋鑫朱仲颖韩朱忠
Owner SHANGHAI DAMENG DATABASE
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Eureka Blog
Learn More
PatSnap group products