Unlock instant, AI-driven research and patent intelligence for your innovation.

Method and device for identifying repetitive association calculation and computer system

An identification method and identification device technology, applied in the field of data processing, can solve problems such as waste of computing resources and storage resources, affecting the operating efficiency of the data platform, and increasing the operating cost of the data platform

Active Publication Date: 2021-02-02
SUNING CLOUD COMPUTING CO LTD
View PDF3 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Such repeated associated calculations will lead to a large waste of computing resources and storage resources, which seriously affects the operating efficiency of the data platform and increases the operating cost of the data platform.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for identifying repetitive association calculation and computer system
  • Method and device for identifying repetitive association calculation and computer system
  • Method and device for identifying repetitive association calculation and computer system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 2

[0066] Corresponding to the above-mentioned embodiments, this application provides a method for identifying repeated correlation calculations, such as image 3 As shown, the method includes:

[0067] 310. Acquire the first SQL statement and the second SQL statement to be identified;

[0068] Preferably, the first SQL statement and the second SQL statement include corresponding data tables to be processed, and the method includes:

[0069] 311. When the corresponding data table to be processed is a temporary table, replace the data table to be processed with a corresponding entity table.

[0070] 320. Parse the first SQL statement, and identify a first associated query included in the first SQL statement, where the associated query includes an associated calculation between data tables required to execute the SQL statement;

[0071] Preferably, the association calculation includes corresponding data tables and association relationship keywords, the association relationship ke...

Embodiment 3

[0089] Corresponding to the above method, this application proposes an identification device for repeated correlation calculation, such as Figure 4 As shown, the device includes:

[0090] An acquisition module 410, configured to acquire the first SQL statement and the second SQL statement to be identified;

[0091] The parsing module 420 is configured to parse the first SQL statement, identify the first associated query included in the first SQL statement, and the associated query includes an associated calculation between data tables that needs to be performed to execute the SQL statement; parse the first SQL statement Two SQL statements, identifying a second associated query included in the second SQL statement;

[0092] The processing module 430 is configured to determine that there is repeated associated calculation between the first SQL statement and the second SQL statement when there is repeated associated calculation in the first associated query and the second assoc...

Embodiment 4

[0099] Corresponding to the above method, device, and system, Embodiment 4 of the present application provides a computer system, including: one or more processors; and a memory associated with the one or more processors, and the memory is used to store program instructions , when the program instructions are read and executed by the one or more processors, perform the following operations:

[0100] Obtaining the first SQL statement and the second SQL statement to be identified;

[0101] Analyzing the first SQL statement, identifying the first associated query included in the first SQL statement, the associated query including the associated calculation between data tables that needs to be performed to execute the SQL statement;

[0102] Parsing the second SQL statement to identify a second associated query included in the second SQL statement;

[0103] When repeated associated calculations exist in the first associated query and the second associated query, it is determined ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a method and device for identifying repetitive association calculation and a computer system. The method comprises the steps: acquiring a first SQL statement and a second SQL statement to be identified; analyzing the first SQL statement, and identifying a first association query included in the first SQL statement, the association query including association calculation between data tables required to be performed for executing the SQL statement; analyzing the second SQL statement, and identifying a second associated query included in the second SQL statement; and whenrepeated association calculation exists in the first association query and the second association query, determining that repetitive association calculation exists in the first SQL statement and the second SQL statement. The method can be used for identifying whether multiple SQL statements contain repetitive association calculation or not, so that the SQL statements containing the repetitive association calculation are conveniently optimized and adjusted subsequently, and the operation efficiency of a data platform is further improved.

Description

technical field [0001] The invention relates to the field of data processing, in particular to an identification method, device and computer system for repeated correlation calculation. Background technique [0002] In data processing scenarios such as big data offline tasks, a large number of SQL statements need to be processed. During the execution of a large number of SQL statements, repeated association calculations on two data tables often occur. Such repeated associated calculations will lead to a large waste of computing resources and storage resources, seriously affecting the operating efficiency of the data platform and increasing the operating cost of the data platform. Therefore, there is an urgent need for a method capable of identifying repeated associated calculations included in multiple SQL statements. Contents of the invention [0003] In order to solve the deficiencies of the prior art, the main purpose of the present invention is to provide a method, d...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F16/242G06F16/22G06F40/284
CPCG06F16/2433G06F16/2282G06F40/284
Inventor 丁庆晏徐伟
Owner SUNING CLOUD COMPUTING CO LTD