Database-based repetitive association detection method, device and equipment, and storage medium

A detection method and database technology, applied in the field of big data, can solve the problems of low detection efficiency, missing scripts, and long time consumption.

Active Publication Date: 2020-03-24
CHINA PING AN PROPERTY INSURANCE CO LTD
View PDF4 Cites 9 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The creation of wide tables in the middle of traditional data warehouses generally requires data analysts to perform manual statistical testing on a large number of existing SQL scripts based on personal experience, to find out which tables can be repeatedly associated. Such manual analysis and statistics, In the case of many scripts, the detection efficiency is low and takes a long time, and some scripts may be missed

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Database-based repetitive association detection method, device and equipment, and storage medium
  • Database-based repetitive association detection method, device and equipment, and storage medium
  • Database-based repetitive association detection method, device and equipment, and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0028] The invention provides a database-based repeated association detection method, device, equipment and storage medium, which are used to split the SQL statement in the structured query language SQL script and count the source table of the repeated association in the SQL, thereby improving the detection efficiency .

[0029] In order to enable those skilled in the art to better understand the solutions of the present invention, the embodiments of the present invention will be described below with reference to the drawings in the embodiments of the present invention.

[0030] The terms "first", "second", "third", "fourth", etc. (if any) in the description and claims of the present invention and the above drawings are used to distinguish similar objects, and not necessarily Used to describe a specific sequence or sequence. It is to be understood that the terms so used are interchangeable under appropriate circumstances such that the embodiments described herein can be pract...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to the technical field of big data, discloses a database-based repeated association detection method, device and equipment and a storage medium, and is used for carrying out statistics on repeatedly associated source tables in SQL (Structured Query Language) by splitting statements in SQL scripts, so that the detection efficiency is improved. The method comprises the following steps: searching a code library of a database, wherein the code library comprises all structured query language (SQL) scripts; analyzing each SQL script to obtain a plurality of SQL paragraphs; preprocessing the plurality of SQL paragraphs to generate a plurality of processed SQL statements; inputting the plurality of processed SQL statements into preset software for analysis to generate at least one pair of source table names associated in pairs; marking the script catalogue of the database according to at least one pair of source table names associated in pairs to generate a marked scriptcatalogue; and according to the marked script directory, performing repeated association detection on the table names of the source tables associated in pairs in all preset SQL scripts, and obtaininga detection result.

Description

technical field [0001] The present invention relates to the technical field of big data, and in particular to a database-based repeated association detection method, device, equipment and storage medium. Background technique [0002] With the rapid development of the Internet, more and more data are processed by computer equipment, and databases are widely used. In the database system, multidimensional data analysis is often required, and the data source is often multiple tables in the relational database, so multi-table association is often required, while the multi-table in structured query language (SQL) Joining is a relatively resource-consuming operation because it involves network input (Input) / output (Output) and full table scanning. [0003] Because in a large database system, different data processing scripts are often developed by different developers, and there may be some repeated multi-table associated SQL statements in a large number of scripts developed. The...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/242G06F16/2455
CPCG06F16/2433G06F16/2455Y02D10/00
Inventor 林堋鑫
Owner CHINA PING AN PROPERTY INSURANCE CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap