A metadata link-based data tracking method and system

A data tracking and data link technology, applied in other database retrieval based on metadata, electronic digital data processing, other database retrieval, etc., can solve the lack of rule setting, visual graphic deviation, lack of data extraction method and loading Strategies and other issues to achieve the effect of reducing losses

Inactive Publication Date: 2019-05-28
SANMENG TECH CO LTD
View PDF11 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

"There is a blood relationship between data-the blood relationship carding method that data governance must understand" published on the Internet. On the one hand, this invention lacks the setting of various rules, which makes the judgment of cleaning, conversion and destruction prone to problems. In terms of lack of description of data extraction methods and loading strategies, it is easy to cause deviations in the visual graph of data blood re

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A metadata link-based data tracking method and system
  • A metadata link-based data tracking method and system
  • A metadata link-based data tracking method and system

Examples

Experimental program
Comparison scheme
Effect test

no. 1 example

[0041] Such as figure 1 As shown, the first embodiment of the metadata link-based data tracking method provided by the present invention includes:

[0042] S101, collecting data transmission logs;

[0043] It is necessary to collect and record specific data transmission logs, not just batch logs. Data transmission logs must include data collection, data cleaning, data conversion, data standardization, data integration, data demise, and other traceable data links. So as to provide the basis for the follow-up tracking of the whole process of data, and realize the whole process tracking from data collection to data provision;

[0044] S102. Generate a field-level metadata link according to the data transmission log;

[0045] S103, according to the uploaded query condition, trace the field-level metadata link matching the query condition;

[0046] S104. Visualize the field-level metadata link to generate a graphical interface;

[0047] Combined with data blood relationship ana...

no. 2 example

[0049] Such as image 3 As shown, the second embodiment of the metadata link-based data tracking method provided by the present invention includes:

[0050] S201, collecting data transmission logs;

[0051]S202. Generate a field-level metadata link according to the data transmission log;

[0052] S203, according to the uploaded query condition, trace the field-level metadata link matching the query condition;

[0053] S204. Visualize the field-level metadata link to generate a graphical interface;

[0054] S205. Obtain the data value of each transfer node in the entire data link according to the tracked field-level metadata link; compare the data values ​​of each transfer node to locate a problematic transfer node.

[0055] For example, in the above example, when the data content named Li Ming is traced, the data value of each transfer node in the entire data link is obtained, that is, the data value of the transfer node named Li Ming in the personnel unified view and the p...

no. 3 example

[0056] Such as Figure 4 As shown, the third embodiment of the metadata link-based data tracking method provided by the present invention includes:

[0057] S301, collecting data transmission logs;

[0058] S302. Generate a field-level metadata link according to the data transmission log;

[0059] S303, according to the uploaded query condition, trace the field-level metadata link matching the query condition;

[0060] S304. Visualize the field-level metadata link to generate a graphical interface;

[0061] S305. Obtain the data value of each transfer node in the entire data link according to the tracked field-level metadata link; compare the data values ​​of each transfer node to locate a problematic transfer node.

[0062] S306. After locating the problematic transfer node, determine the scope of influence caused by the transfer node through data link tracking.

[0063] Since data circulates at each flow node, many different data links are formed, and the data value at t...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a metadata link-based data tracking method. The method comprises the following steps of collecting a data transmission log; generating a field-level metadata link according tothe data transmission log; tracking a field-level metadata link matched with the query condition according to the uploaded query condition; and performing visualization processing on the field-level metadata link to generate a graphical interface. The invention also discloses a metadata link-based data tracking system, which comprises a collection module for collecting data transmission logs; a generation module used for generating a field-level metadata link; a tracking module used for tracking a field-level metadata link matched with the query condition according to the uploaded query condition; and a visualization module used for performing visualization processing on the field-level metadata link to generate a graphical interface. By adopting the method and the system, the specific data can be quickly tracked through the field-level metadata link.

Description

technical field [0001] The present invention relates to the field of data tracking, in particular to a metadata link-based data tracking method and system. Background technique [0002] In the field of information technology, every industry or field depends on information systems to help solve problems and improve efficiency. With the gradual rise of the computer software industry, there are more and more software in every field. If we take people as an analogy, software is equivalent to human organs, each of which has its corresponding value; while data is equivalent to human blood, and better intercommunication between organs requires blood to circulate among them. And data governance is to solve the problem of blood barrier. In data governance-related industries, there are many studies on data links, usually through blood relationship analysis of data to visualize the relationship of data. There are also many researches on blood relationship analysis of data. [0003]...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/907G06F16/9038
Inventor 李果王新宇卢国资陈国镇罗龙
Owner SANMENG TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products