SQL-based data blood relationship analysis method and system

A kind of blood relationship and analysis method technology, applied in the computer field, can solve the problem of low analysis efficiency, and achieve the effect of strengthening monitoring, convenient query and development management

Active Publication Date: 2020-08-14
UNIV OF ELECTRONICS SCI & TECH OF CHINA
View PDF11 Cites 16 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] The purpose of the present invention is to solve the problem that the analysis efficiency of the existing database kinship relationship analysis method is not high, and proposes a SQL-based data kinship relationship analysis method and system

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • SQL-based data blood relationship analysis method and system
  • SQL-based data blood relationship analysis method and system
  • SQL-based data blood relationship analysis method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0036] The embodiment of the present invention provides a SQL-based data blood relationship analysis method, such as figure 1 As shown, the following steps S1-S4 are included:

[0037] S1. Extract the regularized SQL statement from the script file containing the SQL code, and complete the cleaning of the SQL statement.

[0038] Step S1 includes the following sub-steps S11-S12:

[0039] S11. Obtain the script file containing the SQL code, and search for the flag bit of the SQL code.

[0040] In the embodiment of the present invention, the script file is a script such as perl.

[0041] S12. Use flag bits to filter irrelevant content in the script file, and keep the regularized SQL code statement.

[0042] According to an embodiment of the present invention, an example of SQL statement cleaning is as follows:

[0043] CREATE TABLE

[0044] ${icl_db_name}.C_PT_CUSTODY_BAL_ACCUM_TMP_ACCT${TX_DATE}

[0045] (Party_Id VARCHAR(120),Acct_Bal DECIMAL(18,2))

[0046] CLUSTERED BY ...

Embodiment 2

[0088] The embodiment of the present invention provides a SQL-based data blood relationship analysis system, such as image 3 As shown, it includes data cleaning module, data parsing module, blood relationship analysis module and visualization module connected in sequence.

[0089] Among them, the data cleaning module is used to extract the regularized SQL statement from the script file containing the SQL code to complete the cleaning of the SQL statement; the data analysis module is used to perform lexical analysis on the regularized SQL statement to generate an abstract syntax tree, And traverse the abstract syntax tree to analyze the syntax of the SQL statement; the blood relationship analysis module is used to analyze the blood relationship of the SQL statement according to the abstract syntax tree, and obtain the blood relationship analysis result; the visualization module is used to draw the data blood relationship of the SQL statement according to the blood relationship ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an SQL-based data blood relationship analysis method and system. The method comprises the following steps: firstly extracting a regularized SQL statement from a script file containing an SQL code, and completing the cleaning of the SQL statement; performing lexical analysis on the regularized SQL statement to generate an abstract syntax tree, and traversing the abstract syntax tree to perform syntactic analysis on the SQL statement; performing blood relationship analysis on the SQL statement according to the abstract syntax tree to obtain a blood relationship analysis result; and finally, drawing a data blood relationship diagram of the SQL statement according to the blood relationship analysis result, and performing visual display. The blood relationship between the tables of the database is displayed in a graphical mode, the dependency relationship between the tables and the dependency relationship between the fields can be sorted out, and follow-up business query and development management are facilitated.

Description

technical field [0001] The invention belongs to the technical field of computers, and in particular relates to a SQL-based data consanguinity analysis method and system design. Background technique [0002] With the development and application of big data technology, there is a demand for data lineage analysis in the field of big data governance. Through the analysis and processing of structured query statements for database operations, the mapping relationship between tables and fields between databases can be sorted out. , to form a data map, so as to track the flow of data in massive and huge data, check the source of upstream data and the destination of downstream data in the big data system, and facilitate big data developers and business analysts to grasp the consumption and source of data, thereby Better manage big data systems and tap the value of data kinship. However, the existing database kinship analysis methods are usually based on database storage kinship, whi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/242G06F16/248
CPCG06F16/248G06F16/2433Y02D10/00
Inventor 吴晓华庞红樊友平李瑞恒罗瑜
Owner UNIV OF ELECTRONICS SCI & TECH OF CHINA
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products