Data consanguinity analysis method and device, electronic equipment and storage medium

An analysis method and data technology, applied in the field of data processing, can solve the problems of inability to obtain blood relationship, increase the cost of data screening, etc., and achieve the effect of improving efficiency and reducing costs.

Pending Publication Date: 2021-06-25
GUANGZHOU HUYA TECH CO LTD
View PDF0 Cites 8 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In the process of data construction and management, the blood relationship between data will be generated in the process of data generation, processing and circulation. When the amount of data continues to increase, the blood relationship between data will become more complicated. When data quality problems occur, due to It is impossible to obtain the blood relationship between data at different levels. Therefore, it is necessary to screen the data layer by layer, which greatly increases the cost of data screening.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data consanguinity analysis method and device, electronic equipment and storage medium
  • Data consanguinity analysis method and device, electronic equipment and storage medium
  • Data consanguinity analysis method and device, electronic equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0016] The following will clearly and completely describe the technical solutions in the embodiments of the present application with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only some of the embodiments of the present application, not all of them. Based on the embodiments in this application, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the scope of protection of this application.

[0017] The terms "system" and "network" are often used interchangeably herein. The term "and / or" in this article is just an association relationship describing associated objects, which means that there can be three relationships, for example, A and / or B can mean: A exists alone, A and B exist simultaneously, and there exists alone B these three situations. In addition, the character " / " in this article generally indicates that the contextual objects are an "...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a data consanguinity analysis method and device, electronic equipment and a storage medium, and the data consanguinity analysis method comprises the steps: obtaining a to-be-processed SQL statement, and converting the SQL statement into an abstract syntax tree; obtaining an analysis rule and an analysis strategy of the abstract syntax tree, wherein various types of data corresponding to the SQL statement respectively correspond to an analysis rule, and the analysis rule comprises different analysis strategies for nodes of different hierarchies of the abstract syntax tree; based on the analysis rule and the analysis strategy of the abstract syntax tree, traversing nodes of multiple levels of the abstract syntax tree; converting the abstract syntax tree into a logic execution plan by using nodes of multiple levels; and performing iterative analysis on the logic execution plan to obtain a blood relationship between data corresponding to the SQL statements. By means of the mode, the blood relationship between the data in the data processing process can be obtained, and the data screening cost is reduced.

Description

technical field [0001] The present application relates to the technical field of data processing, in particular to a data lineage analysis method, device, electronic equipment and storage medium. Background technique [0002] With the advent of the era of data explosion, data has become an important asset for both individuals and enterprises. In the process of data construction and management, the blood relationship between data will be generated in the process of data generation, processing and circulation. When the amount of data continues to increase, the blood relationship between data will become more complicated. When data quality problems occur, due to The blood relationship between data at different levels cannot be obtained. Therefore, it is necessary to screen the data layer by layer, which greatly increases the cost of data screening. In view of this, how to obtain the blood relationship between data in the process of data processing and reduce the cost of data s...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/21G06F16/215G06F16/22G06F8/75
CPCG06F16/21G06F16/215G06F16/22G06F8/75
Inventor 于泽陈颖林义明郭酉晨解翔
Owner GUANGZHOU HUYA TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products