Structured query language script analysis method, device and system

A script parsing and scripting technology, applied in the field of metadata management, can solve the problems of missing data flow semantic information, lack of comprehensive contextual environment to parse SQL script data flow semantics, lack of contextual environment analysis and processing methods, etc., to improve integrity and accuracy. performance, ensuring the quality of acquisition

Active Publication Date: 2012-03-14
CHINA MOBILE COMM GRP CO LTD +1
View PDF0 Cites 31 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Without these context information, it is difficult to ensure the quality of metadata generation when the subsequent processing links encounter context-related SQL scripts
[0012] 2. Metadata generation in link three lacks contextual analysis and processing methods
[0013] In link three, the existing solution is limited by link one on the one hand, and on the other hand, there is no comprehensive context environment to analyze the data flow semantics of SQL scripts in this link, and each SQL script

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Structured query language script analysis method, device and system
  • Structured query language script analysis method, device and system
  • Structured query language script analysis method, device and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0038] In the present invention, in the ETL and data processing process of the data warehouse system, each time the script program runs, the relevant content is written into the running log, and the running log is output to the running log area.

[0039] The running log area is a running log storage device, which can be implemented in the following two ways in terms of physical implementation:

[0040] 1. File directory, the operation log is submitted to these file directories in the form of log files;

[0041] 2. Database tables, the operation logs are written into these database tables in the form of database table records.

[0042] If the file directory method is used, the running log area can be distributed on multiple hosts. Each host determines the directory structure of the running log area according to the deployment of the local script program. The running log of the script program is output to the specified directory. The SQL script analysis device accesses the ru...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an SQL script analysis method, an SQL script analysis device and an SQL script analysis system. The SQL script analysis method comprises: A, extracting SQL scripts from running logs according to the SQL script execution sequence in the running log; B, performing the morphologic, grammar and semantic analysis of each SQL script in turn and generating a semantic result collection of the SQL scripts; and C, analyzing the type of the context of the SQL scripts according to the semantic result collection, generating the context correlation information of all SQL scripts in the running log, and acquiring the data flow information of the running log according to the semantic result collection and the context correlation information. When the SQL script analysis method, the SQL script analysis device and the SQL script analysis system, which are disclosed by the invention, are used, by morphologic, grammar and semantic analysis of the SQL scripts and the analysis on the context correlation, the loss of data flow semantic information is avoided when the metadata of the SQL scripts are generated; and thus, the integrity and accuracy of the acquired metadata of the SQL scripts are improved and the acquisition quality of the metadata of the SQL scripts is guaranteed.

Description

technical field [0001] The invention relates to a metadata management technology, in particular to an SQL script parsing method, device and system. Background technique [0002] At present, many large enterprises such as communication, finance and other industries have established metadata management systems to strengthen the effective management of the increasingly expanding data warehouse system. Among these metadata management systems, most of them still manage SQL script metadata manually. In recent years, some enterprises have begun to try an automatic acquisition of SQL script metadata. This scheme is based on compilation technology, trying to extract the SQL scripts of ETL and data processing, and then perform lexical, grammatical and semantic analysis on these SQL scripts, and translate the obtained SQL script data flow information into SQL script metadata. [0003] The whole scheme is divided into 3 links. In the first link, there are currently three main ways to ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30
Inventor 何鸿凌陈仲亮魏春辉李政陶涛林旭薛勇
Owner CHINA MOBILE COMM GRP CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products