Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Structured query language script analysis method, device and system

A script parsing and scripting technology, applied in the field of metadata management, can solve the problems of missing data flow semantic information, lack of comprehensive contextual environment to parse SQL script data flow semantics, lack of contextual environment analysis and processing methods, etc., to improve integrity and accuracy. performance, ensuring the quality of acquisition

Active Publication Date: 2014-12-31
CHINA MOBILE COMM GRP CO LTD +1
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Without these context information, it is difficult to ensure the quality of metadata generation when the subsequent processing links encounter context-related SQL scripts
[0012] 2. Metadata generation in link three lacks contextual analysis and processing methods
[0013] In link three, the existing solution is limited by link one on the one hand, and on the other hand, there is no comprehensive context environment to analyze the data flow semantics of SQL scripts in this link, and each SQL script is isolated and processed
When SQL scripts have context-sensitive features, metadata is often not generated correctly
[0014] To sum up, although the existing solutions can solve the problem of metadata management of SQL scripts to a certain extent, the existing solutions do not provide a mechanism to organically organize SQL scripts and related context auxiliary information, which may be lost Some data flow semantic information affects the quality of automatic acquisition of SQL script metadata

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Structured query language script analysis method, device and system
  • Structured query language script analysis method, device and system
  • Structured query language script analysis method, device and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0038] In the present invention, during the ETL and data processing of the data warehouse system, every time the script program runs, relevant content is written into the running log, and the running log is output to the running log area.

[0039] The running log area is a running log storage device. The following two methods can be used in physical realization:

[0040] 1. File directory, the operation log is submitted to these file directories in the form of log files;

[0041] 2. Database tables, running logs are written into these database tables in the form of database table records.

[0042] If the file directory method is adopted, the operation log area can be distributed on multiple hosts. Each host determines the directory structure of the running log area according to the deployment of the script program of the machine. The running log of the script program is output to the specified directory. The SQL script analysis device accesses the operation log storage device throug...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses an SQL script analysis method, an SQL script analysis device and an SQL script analysis system. The SQL script analysis method comprises: A, extracting SQL scripts from running logs according to the SQL script execution sequence in the running log; B, performing the morphologic, grammar and semantic analysis of each SQL script in turn and generating a semantic result collection of the SQL scripts; and C, analyzing the type of the context of the SQL scripts according to the semantic result collection, generating the context correlation information of all SQL scripts in the running log, and acquiring the data flow information of the running log according to the semantic result collection and the context correlation information. When the SQL script analysis method, the SQL script analysis device and the SQL script analysis system, which are disclosed by the invention, are used, by morphologic, grammar and semantic analysis of the SQL scripts and the analysis on the context correlation, the loss of data flow semantic information is avoided when the metadata of the SQL scripts are generated; and thus, the integrity and accuracy of the acquired metadata of the SQL scripts are improved and the acquisition quality of the metadata of the SQL scripts is guaranteed.

Description

Technical field [0001] The invention relates to a metadata management technology, in particular to a SQL script analysis method, device and system. Background technique [0002] At present, many large enterprises such as communications, finance and other industries have established metadata management systems to strengthen the effective management of the increasingly expanding data warehouse system. In these metadata management systems, most of them still manage SQL script metadata by manual sorting. Some companies have begun to try a SQL script metadata automatic acquisition program in recent years. This solution is based on compilation technology, trying to extract the SQL scripts of ETL and data processing, then perform lexical, grammatical and semantic analysis on these SQL scripts, and translate the obtained SQL script data flow information into SQL script metadata. [0003] The whole plan is divided into 3 links. In the first link, there are currently three main ways to obt...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F17/30
Inventor 何鸿凌陈仲亮魏春辉李政陶涛林旭薛勇
Owner CHINA MOBILE COMM GRP CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products