SQL interactive data preprocessing method and device based on transaction time sequence directed graph

An interactive data and directed graph technology, which is used in electrical digital data processing, special data processing applications, digital data information retrieval, etc., and can solve problems such as inappropriate data analysis and mining, and without considering the relationship between SQL interactive instructions.

Active Publication Date: 2021-02-19
STATE GRID ELECTRIC POWER RES INST +3
View PDF3 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the existing technology only processes a single piece of SQL data, without considering the relationship between SQ

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • SQL interactive data preprocessing method and device based on transaction time sequence directed graph
  • SQL interactive data preprocessing method and device based on transaction time sequence directed graph
  • SQL interactive data preprocessing method and device based on transaction time sequence directed graph

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0057] The present invention will be further described below in conjunction with specific examples.

[0058] Such as figure 1 As shown, a method and device for preprocessing SQL interactive data based on transaction timing directed graph, firstly, training is performed on the SQL interactive command data sample that the business system oriented to business acquisition interacts with the database through JDBC, taking the session as the unit, for The SQL statement executed in the session is identified, and the transaction sequence is restored according to the execution order, and all transaction sequences are constructed to form a transaction timing directed graph for the business. Then, use the time series directed graph of business transactions as a template to preprocess the massive raw SQL interactive instruction data in the production environment. Through template matching, you only need to output which template hits without repeatedly recording the detailed data in the tem...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an SQL interaction data preprocessing method and device based on a transaction time sequence directed graph, and the method comprises the steps: carrying out normal form training according to original SQL interaction instruction data in a business system, obtaining a trained SQL execution instruction set SqlCmdSet, and constructing a trained business-oriented transaction time sequence directed graph; obtaining actual SQL interaction instruction data in a business system production environment, performing paradigm to obtain an actual SQL execution instruction set SqlCmdSet, and obtaining an actual transaction sequence set session Transaction Set; and matching the actual transaction sequence set session Transaction Set with a trained business-oriented transaction timesequence directed graph according to the actual transaction sequence set session Transaction Set, and outputting a graph path corresponding to the actual SQL interaction instruction data. Effective data can be reserved to the maximum extent, and useless data can be removed. Repeated parts of the same transaction operation in the original data are extracted to the maximum extent, and duplicate removal of the original data is achieved.

Description

technical field [0001] The invention relates to a SQL interactive data preprocessing method and device based on a transaction sequence directed graph, and belongs to the technical field of database intrusion detection. Background technique [0002] In actual business scenarios, the large amount of SQL interaction instructions generated is messy, and there are a large number of dirty, similar, and repetitive instructions. The existence of these instructions may cause data interaction to fall into chaos, which will bring more problems for subsequent data analysis and data mining. Increase the difficulty, and lead to a lot of repetitive analysis work, and even affect user management decisions. Therefore, it is necessary to preprocess a large number of SQL interactive instructions to obtain a clean and non-repetitive set of SQL instructions, which is crucial for data analysis and data mining. [0003] At present, research on data detection and data cleaning technologies involve...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/215G06F16/242
CPCG06F16/215G06F16/2433
Inventor 金倩倩张旭东韦小刚邓进郭靓田鹏飞张滔何金栋吴丹赵志超吴丽进
Owner STATE GRID ELECTRIC POWER RES INST
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products