Structured query language script analysis method, device and system
A script parsing and scripting technology, applied in the field of metadata management, can solve the problems of missing data flow semantic information, lack of comprehensive contextual environment to parse SQL script data flow semantics, lack of contextual environment analysis and processing methods, etc., to improve integrity and accuracy. performance, ensuring the quality of acquisition
A script parsing and scripting technology, applied in the field of metadata management, can solve the problems of missing data flow semantic information, lack of comprehensive contextual environment to parse SQL script data flow semantics, lack of contextual environment analysis and processing methods, etc., to improve integrity and accuracy. performance, ensuring the quality of acquisition
CN102375826BActive Publication Date: 2014-12-31CHINA MOBILE COMM GRP CO LTD +1
Image
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0038] In the present invention, during the ETL and data processing of the data warehouse system, every time the script program runs, relevant content is written into the running log, and the running log is output to the running log area.
[0039] The running log area is a running log storage device. The following two methods can be used in physical realization:
[0040] 1. File directory, the operation log is submitted to these file directories in the form of log files;
[0041] 2. Database tables, running logs are written into these database tables in the form of database table records.
[0042] If the file directory method is adopted, the operation log area can be distributed on multiple hosts. Each host determines the directory structure of the running log area according to the deployment of the script program of the machine. The running log of the script program is output to the specified directory. The SQL script analysis device accesses the operation log storage device throug...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention discloses an SQL script analysis method, an SQL script analysis device and an SQL script analysis system. The SQL script analysis method comprises: A, extracting SQL scripts from running logs according to the SQL script execution sequence in the running log; B, performing the morphologic, grammar and semantic analysis of each SQL script in turn and generating a semantic result collection of the SQL scripts; and C, analyzing the type of the context of the SQL scripts according to the semantic result collection, generating the context correlation information of all SQL scripts in the running log, and acquiring the data flow information of the running log according to the semantic result collection and the context correlation information. When the SQL script analysis method, the SQL script analysis device and the SQL script analysis system, which are disclosed by the invention, are used, by morphologic, grammar and semantic analysis of the SQL scripts and the analysis on the context correlation, the loss of data flow semantic information is avoided when the metadata of the SQL scripts are generated; and thus, the integrity and accuracy of the acquired metadata of the SQL scripts are improved and the acquisition quality of the metadata of the SQL scripts is guaranteed.
Description
Technical field [0001] The invention relates to a metadata management technology, in particular to a SQL script analysis method, device and system. Background technique [0002] At present, many large enterprises such as communications, finance and other industries have established metadata management systems to strengthen the effective management of the increasingly expanding data warehouse system. In these metadata management systems, most of them still manage SQL script metadata by manual sorting. Some companies have begun to try a SQL script metadata automatic acquisition program in recent years. This solution is based on compilation technology, trying to extract the SQL scripts of ETL and data processing, then perform lexical, grammatical and semantic analysis on these SQL scripts, and translate the obtained SQL script data flow information into SQL script metadata. [0003] The whole plan is divided into 3 links. In the first link, there are currently three main ways to obt...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
31 Dec 2014
Publication
CN102375826B
- IPC
- G06F17/30
- Inventors
- 何鸿凌; 陈仲亮