A system and method for information data return based on data lineage

Abstract

The invention relates to the technical field of data processing and sharing of enterprises, institutions and government departments, in particular to a system and a method for system and method for information data return based on data lineage. The system includes a data acquisition unit to collect the information data of the data source side; a data processing unit which cleans, extracts and integrates the collected information data, and establishes a shared platform database; a data application unit which applies the integrated information data in real time on demand. The data reflux unit reflux feeds back the modified information data in real time. The system and the method provided by the invention can quickly trace the data source according to the data lineage information, thereby effectively improving the efficiency of the data return and saving the workload. It can automatically record the source information of data, reduce the error rate of manual intervention, realize the highaccuracy of data return, and avoid the loss caused by data asymmetry. The effective supplement to the data traceability management method in data management can ensure the standardization and consistency of data traceability.

Description

technical field [0001] The invention relates to the technical field of data processing and sharing in enterprises, public institutions and government departments, and in particular to an information data return system and method based on data lineage. Background technique [0002] In order to solve the problem of "information islands", enterprises and government departments are gradually building data sharing and exchange platforms (referred to as data sharing platforms), through which data resources from different sources can be brought together, and various special topics can be formed after cleaning and integration. library, and then share it with various departments for use through front-end computers or interfaces. The thematic shared library is formed by integrating data resources from different sources, and when shared, it will be provided to different data users, thus forming a data lineage in the process of data provision, data integration and data use. Data lineag...

AI Technical Summary

Problems solved by technology

[0010] In order to overcome the above-mentioned traditional data backflow, it is difficult for the data modification party to know in a timely and accurate manner which source departments and departments use the updated data, and it is difficult to achieve update notifications at the data field level, and the notified departments often need to judge by themselves which data Items have been changed, resulting in inconsistency of information between systems, resulting in untimely and inaccurate data used by the application system

Images