Data traceability system and method applied to data sharing and exchanging platform

By designing a data traceability system on the data sharing and exchange platform, the problem of how to build directory data and realize data traceability is solved, and the traceability and authenticity guarantee of government service data is realized.

CN119807263AInactive Publication Date: 2025-04-11SHANDONG LANGCHAO YUNTOU INFORMATION TECH CO LTD
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
CN202411731406.7
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-11-29
Publication Date
2025-04-11
Estimated Expiration
Not applicable · inactive patent

AI Technical Summary

Technical Problem

In the field of government services, the issue of how to build directory data and realize data traceability through directory data, especially on data sharing and exchange platforms.

Method used

A data traceability system is designed, including the front module, the original module, the central module, the analysis module, the service module and the client. The system realizes data traceability through steps such as data preprocessing, metadata association, data access interface, analysis and mining, and service operations.

Benefits of technology

It has realized the traceability of business data on the data sharing and exchange platform related to government services, ensured the authenticity and reliability of the data, and enhanced the people's trust in government services.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119807263A_ABST
    Figure CN119807263A_ABST
Patent Text Reader

Abstract

The invention discloses a data traceability system and method applied to a data sharing and exchanging platform, belongs to the technical field of software systems, and aims to solve the technical problem of how to construct directory data and realize data traceability through the directory data for the data sharing and exchanging platform related to government affair service. And storing the preprocessed business data, metadata and annotation records of the business data and an association relationship between the business data and the metadata into an original module, and providing data access for functional modules in the traceability system and other third-party systems through a data access interface provided by a central module. The method comprises the steps that service data are analyzed and mined through an analysis module, the data exchange process is recorded to form a data exchange record, the service data are analyzed and mined through the analysis module, the data exchange process is recorded to form a data exchange record, and an original module updates labeling records of related service data based on the data exchange record, the data analysis and mining record and a service operation record. And the business data can be traced conveniently.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of software systems, and in particular to a data tracing system and method applied to a data sharing and exchange platform. Background Art

[0002] In the information age, government transparency is directly related to the public's trust in government services. By building a government directory data traceability system, we can clearly display the source, circulation and use of government data to ensure the authenticity and reliability of the data. This will help enhance the public's trust in government services and improve the credibility of government services.

[0003] Directory data in government systems refers to a data classification and organization method and classification results for government agencies to classify all data resources they own. The government data resource directory is one of the infrastructures for managing government information resources. Its main purpose is to help data analysts discover and understand data. It is the core of data management, data accountability, and data governance.

[0004] In the field of government services, data sharing and interaction platforms can realize the sharing and exchange of data between different business systems. For data sharing and exchange platforms related to government services, how to build directory data and realize data traceability through directory data are technical issues that need to be solved. Summary of the invention

[0005] The technical task of the present invention is to address the above deficiencies and provide a data traceability system and method applied to a data sharing and exchange platform to solve the technical problems of a data sharing and exchange platform related to government services, how to construct directory data and realize data traceability through directory data.

[0006] In a first aspect, the present invention provides a data tracing system for a data sharing and exchange platform, comprising a plurality of functional modules, namely, a front-end module, an original module, a central module, an analysis module, a service module and a client;

[0007] The front-end module is used to collect business data from the data source, pre-process the business data, associate the business data with metadata, and send the processed business data, the metadata and annotation records of the business data, and the association between the business data and metadata to the original module, where the annotation records are used to record the source, evolution process and destination of the business data;

[0008] The original module is used to store processed business data, metadata and origin information of business data, and the relationship between business data and metadata;

[0009] The central module is used to provide a data access interface for each functional module and a third-party system, receive data access requests through the data access interface, and perform data exchange operations on relevant business data based on the data access requests, record the data exchange process and form a data exchange record, read the business data specified by the data access request from the original module through the data exchange operation and return the business data, and the data exchange record at least includes the destination information of the business data; correspondingly, the original module is used to update the annotation record of the corresponding business data based on the data exchange record;

[0010] The analysis module is used to obtain business data from the central module, and analyze and mine the business data through the pre-configured analysis and mining algorithm, record the analysis and mining process, analysis and mining algorithm and analysis and mining results, and form a data analysis and mining record;

[0011] The client provides a user interface for interacting with the user, and is used to receive user requests submitted by the user and forward the user requests to the service module;

[0012] The service module is used to receive service requests and cooperate with the original module, central module and analysis module to perform service operations. It is used to record the service operation process to form a service operation record and return the response to the service request to the client. Correspondingly, the original module is used to update the annotation records of related business data based on the service operation record.

[0013] Preferably, the front-end module is used to perform the following data preprocessing on the business data and data association between the business data and the metadata:

[0014] Clean the business data by filling missing values, correcting erroneous values, and reconstructing and deleting records to obtain the cleaned business data.

[0015] Perform data format conversion on the cleaned business data, convert business data in different formats into a unified format, and establish a data conversion mapping table to record the data format conversion rules and data format conversion process through the data conversion mapping table;

[0016] For various types of business data, the business data and its metadata are associated with each other, and a metadata management system is established. Through the data management system, various types of business data and their metadata in the shared exchange platform are uniformly managed and maintained, and each piece of business data is annotated and recorded through data annotation.

[0017] Preferably, for each piece of business data, the annotation record includes the source of the business data, generation time, generator, operation time and operator of each operation on the business data, and destination, wherein the operation includes operations based on data access requests and operations based on service requests.

[0018] Preferably, for the client, the service request submitted by the user includes a query request and a modification request;

[0019] For query requests, the service module cooperates with the original module, the central module and the analysis module to provide query operations, and records the query operation process to form a query operation record. Through the query operation, the record chain, data exchange record and data analysis and mining record of the specified business data in the query request are read to perform the query, and the query result is returned to the client. The query operation record is used to record the user's query request, query operation process and query result, wherein the query operation process includes the query time and the queryer as the operator;

[0020] For modification requests, the service module cooperates with the original module, the central module and the analysis module to provide modification operations, and records the modification operation process to form a modification operation record. Through the modification operation, the record chain, data exchange record and data analysis and mining record of the specified business data in the modification request are read to make modifications, and the modification results are returned to the client. The modification operation record is used to record the user's modification request, modification operation process and modification results, where the modification operation process includes the operation time and the modifier as the operator.

[0021] In a second aspect, the present invention provides a data tracing method applied to a data sharing and exchange platform, which is used to implement data tracing through a data tracing system applied to a data sharing and exchange platform as described in any one of the first aspects, and the method comprises the following steps:

[0022] The front-end module collects business data from the data source, pre-processes the business data, and associates the business data with metadata. The processed business data, the metadata and annotation records of the business data, and the association between the business data and metadata are sent to the original module, where the annotation records are used to record the source, evolution process, and destination of the business data;

[0023] The original module stores the processed business data, the metadata and origin information of the business data, and the association between the business data and the metadata;

[0024] Receive data access requests through the data access interface provided by the central module, and perform data exchange operations on relevant business data based on the data access requests, record the data exchange process and form a data exchange record, read the business data specified by the data access request from the original module through the data exchange operation and return the business data, and the data exchange record at least includes the destination information of the business data; correspondingly, update the annotation record of the corresponding business data through the original module based on the data exchange record;

[0025] The analysis module obtains business data from the central module, and analyzes and mines the business data through the pre-configured analysis and mining algorithm, records the analysis and mining process, analysis and mining algorithm and analysis and mining results, and forms a data analysis and mining record;

[0026] Receive user requests submitted by users through the client and forward the user requests to the service module;

[0027] In response to user requests, the service module cooperates with the original module, the central module and the analysis module to perform service operations, record the service operation process to form a service operation record, and return a response to the service request to the client; correspondingly, based on the service operation record, the annotation records of the relevant business data are updated through the original module.

[0028] Preferably, preprocessing the business data and associating the business data with the metadata includes the following steps:

[0029] Clean the business data by filling missing values, correcting erroneous values, and reconstructing and deleting records to obtain the cleaned business data.

[0030] Perform data format conversion on the cleaned business data, convert business data in different formats into a unified format, and establish a data conversion mapping table to record the data format conversion rules and data format conversion process through the data conversion mapping table;

[0031] For various types of business data, the business data and its metadata are associated with each other, and a metadata management system is established. Through the data management system, various types of business data and their metadata in the shared exchange platform are uniformly managed and maintained, and each piece of business data is annotated and recorded through data annotation.

[0032] Preferably, for each piece of business data, the annotation record includes the source of the business data, generation time, generator, operation time and operator of each operation on the business data, and destination, wherein the operation includes operations based on data access requests and operations based on service requests.

[0033] Preferably, the service request submitted by the user includes a query request and a modification request;

[0034] For query requests, the service module cooperates with the original module, the central module and the analysis module to provide query operations, and records the query operation process to form a query operation record. Through the query operation, the record chain, data exchange record and data analysis and mining record of the specified business data in the query request are read to perform the query, and the query result is returned to the client. The query operation record is used to record the user's query request, query operation process and query result, wherein the query operation process includes the query time and the queryer as the operator;

[0035] For modification requests, the service module cooperates with the original module, the central module and the analysis module to provide modification operations, and records the modification operation process to form a modification operation record. Through the modification operation, the record chain, data exchange record and data analysis and mining record of the specified business data in the modification request are read to make modifications, and the modification results are returned to the client. The modification operation record is used to record the user's modification request, modification operation process and modification results, where the modification operation process includes the operation time and the modifier as the operator.

[0036] The data tracing system and method applied to the data sharing and exchange platform of the present invention have the following advantages:

[0037] 1. For the business data collected from the data source, the pre-processed business data, the metadata and annotation records of the business data, and the association between the business data and the metadata are stored in the original module, and the data access interface provided by the central module is provided for the functional modules in the traceability system and other third-party systems to access the data, and the data exchange process is recorded to form a data exchange record. The business data is analyzed and mined through the analysis module, and the data exchange process is recorded to form a data exchange record. The service module cooperates with the original module, the central module and the analysis module to perform service operations, and records the service operation process to form a service operation record. At the same time, the original module updates the annotation records of the relevant business data based on the data exchange records, data analysis and mining records and service operation records. The annotation records serve as the record chain of the business data to timely update the evolution process of the business data, which is convenient for the traceability of the business data;

[0038] 2. Perform data cleansing and format conversion on the business data collected from the data source, and establish a data conversion mapping table. The data conversion mapping table records the data format conversion rules and the data format conversion process. On the one hand, it realizes data unification to facilitate the subsequent service provision, and at the same time, it regularizes data conversion and realizes the standardization of business data processing. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0040] The present invention is further described below in conjunction with the accompanying drawings.

[0041] Figure 1 This is a flowchart of a data tracing method applied to a data sharing and exchange platform in Example 2. DETAILED DESCRIPTION

[0042] The present invention is further described below in conjunction with the accompanying drawings and specific embodiments so that those skilled in the art can better understand the present invention and implement it. However, the embodiments are not intended to limit the present invention. In the absence of conflict, the embodiments of the present invention and the technical features in the embodiments may be combined with each other.

[0043] The embodiments of the present invention provide a data tracing system and method applied to a data sharing and exchange platform, which are used to solve the technical problems of how to construct directory data and realize data tracing through directory data for a data sharing and exchange platform related to government services.

[0044] Embodiment 1:

[0045] The present invention discloses a data tracing system applied to a data sharing and exchange platform, comprising a plurality of functional modules, namely a front module, an original module, a central module, an analysis module, a service module and a client.

[0046] The front-end module is used to collect business data from the data source, pre-process the business data, and associate the business data with metadata, and send the processed business data, the metadata and annotation records of the business data, and the association between the business data and metadata to the original module, where the annotation records are used to record the source, evolution process and destination of the business data.

[0047] As a specific implementation of the front-end module, this module is used to perform the following data preprocessing on the business data and data association between the business data and metadata:

[0048] (1) Cleaning the business data by filling missing values, correcting erroneous values, and reconstructing and deleting records to obtain cleaned business data;

[0049] (2) Perform data format conversion on the cleaned business data, convert business data in different formats into a unified format, and establish a data conversion mapping table to record the data format conversion rules and data format conversion process through the data conversion mapping table;

[0050] (3) For each type of business data, the business data and its metadata are associated with each other and a metadata management system is established. The data management system is used to uniformly manage and maintain the various types of business data and their metadata in the shared exchange platform, and each piece of business data is annotated and recorded through data annotation.

[0051] The original module is used to store processed business data, metadata and origin information of business data, and the association between business data and metadata.

[0052] In this embodiment, the original module can manage the annotation records as the business data record chain through distributed storage technologies such as Hadoop to improve storage efficiency and access performance.

[0053] The central module is used to provide a data access interface for each functional module and a third-party system, receive data access requests through the data access interface, and perform data exchange operations on relevant business data based on the data access requests, record the data exchange process and form a data exchange record, read the business data specified in the data access request from the original module through the data exchange operation and return the business data, and the data exchange record includes at least the destination information of the business data; correspondingly, the original module is used to update the annotation record of the corresponding business data based on the data exchange record.

[0054] The analysis module is used to obtain business data from the central module, and analyze and mine the business data through pre-configured analysis and mining algorithms, record the analysis and mining process, analysis and mining algorithms and analysis and mining results, and form data analysis and mining records.

[0055] The client provides a user interface for interacting with the user, and is used to receive user requests submitted by the user and forward the user requests to the service module.

[0056] The service module is used to receive service requests and cooperate with the original module, central module and analysis module to perform service operations. It is used to record the service operation process to form a service operation record and return the response to the service request to the client. Correspondingly, the original module is used to update the annotation records of related business data based on the service operation record.

[0057] In this embodiment, for the client, the service request submitted by the user includes a query request and a modification request.

[0058] For query requests, the service module cooperates with the original module, the central module and the analysis module to provide query operations, and records the query operation process to form a query operation record. Through the query operation, the record chain, data exchange record and data analysis and mining record of the specified business data in the query request are read to perform queries, and the query results are returned to the client. The query operation record is used to record the user's query request, query operation process and query results, where the query operation process includes the query time and the inquirer as the operator.

[0059] For modification requests, the service module cooperates with the original module, the central module and the analysis module to provide modification operations, and records the modification operation process to form a modification operation record. Through the modification operation, the record chain, data exchange record and data analysis and mining record of the specified business data in the modification request are read to make modifications, and the modification results are returned to the client. The modification operation record is used to record the user's modification request, modification operation process and modification results, where the modification operation process includes the operation time and the modifier as the operator.

[0060] In this embodiment, for each piece of business data, the annotation record includes the source of the business data, the generation time, the generator, the operation time and operator of each operation on the business data, and the destination, where the operation includes operations based on data access requests and operations based on service requests.

[0061] The traceability system of this embodiment can realize the traceability of various types of business data stored in the data sharing and exchange platform, and mainly provides two services: data collection and data traceability.

[0062] Data collection: For the business data collected from the data source, data cleaning is performed on various types of business data, and the detected erroneous data is corrected, such as filling missing values, correcting erroneous values, deleting duplicate records, etc. The business data after data cleaning is finally stored in the original module, that is, it flows back to the data sharing and exchange platform; the cleaned business data may not be directly used for sharing and tracing due to differences in format, coding, unit, etc., so data conversion is performed on these business data, and business data in different formats are converted into a unified format. A data conversion mapping table is established to record the rules and processes of data conversion. The pre-processed business data is stored in the original module, that is, the pre-processed business data is integrated into the database of the sharing and exchange platform to form a unified data view; an association relationship is established between business data and metadata, and the association relationship is stored in the original module. A metadata management system is established to uniformly manage and maintain various types of business data and their metadata in the data sharing and exchange platform, and the business data is annotated and recorded. The source, evolution process and destination of the business data are identified through the annotated records, so that data tracing can be performed when necessary.

[0063] Data traceability: Various operations on business data, such as data exchange operations, sharing and mining operations, and service operations are recorded, and the data annotations of business data are updated based on the records. All annotation records generated during data operations are organized into an annotation record chain in chronological order. During the data propagation process, the record chain should move and propagate with the data. Whenever the data is accessed or modified, the record chain will be updated in real time. Based on this record chain, the traceability of business data can be achieved.

[0064] Embodiment 2:

[0065] The present invention provides a data tracing method applied to a data sharing and exchange platform, which implements data tracing through the system disclosed in Example 1. The method includes the following steps:

[0066] Step S100: collect business data from a data source through a front-end module, perform data preprocessing on the business data, and perform data association between the business data and metadata, and send the processed business data, the metadata and annotation records of the business data, and the association relationship between the business data and the metadata to the original module, wherein the annotation records are used to record the source, evolution process, and destination of the business data;

[0067] Step S200: storing the processed business data, metadata and origin information of the business data, and the association between the business data and the metadata through the original module;

[0068] Step S300: receiving a data access request through a data access interface provided by the central module, and performing a data exchange operation on relevant business data based on the data access request, recording the data exchange process and forming a data exchange record, reading the business data specified by the data access request from the original module through the data exchange operation and returning the business data, wherein the data exchange record includes at least the destination information of the business data; correspondingly, updating the annotation record of the corresponding business data through the original module based on the data exchange record;

[0069] Step S400: Obtain business data from the central module through the analysis module, and analyze and mine the business data through the pre-configured analysis and mining algorithm, record the analysis and mining process, analysis and mining algorithm and analysis and mining results, and form a data analysis and mining record;

[0070] Step S500: receiving a user request submitted by a user through a client and forwarding the user request to a service module;

[0071] Step S600: For user requests, the service module cooperates with the original module, the central module and the analysis module to perform service operations, record the service operation process to form a service operation record, and return a response to the service request to the client; correspondingly, based on the service operation record, the annotation record of the relevant business data is updated through the original module.

[0072] In step S100 of this embodiment, data preprocessing is performed on the business data, and data association is performed between the business data and the metadata, including the following steps:

[0073] (1) Cleaning the business data by filling missing values, correcting erroneous values, and reconstructing and deleting records to obtain cleaned business data;

[0074] (2) Perform data format conversion on the cleaned business data, convert business data in different formats into a unified format, and establish a data conversion mapping table to record the data format conversion rules and data format conversion process through the data conversion mapping table;

[0075] (3) For each type of business data, the business data and its metadata are associated with each other and a metadata management system is established. The data management system is used to uniformly manage and maintain the various types of business data and their metadata in the shared exchange platform, and each piece of business data is annotated and recorded through data annotation.

[0076] In step S200, the annotated records as the business data record chain can be managed by distributed storage technologies such as Hadoop to improve storage efficiency and access performance.

[0077] The service request in step S500 includes a query request and a modification request.

[0078] In step S600, for the query request, the service module cooperates with the original module, the central module and the analysis module to provide a query operation, and records the query operation process to form a query operation record. The query operation reads the record chain, data exchange record and data analysis and mining record of the specified business data in the query request to perform a query, and returns the query result to the client. The query operation record is used to record the user's query request, query operation process and query result, wherein the query operation process includes the query time and the inquirer as the operator.

[0079] For modification requests, the service module cooperates with the original module, the central module and the analysis module to provide modification operations, and records the modification operation process to form a modification operation record. Through the modification operation, the record chain, data exchange record and data analysis and mining record of the specified business data in the modification request are read to make modifications, and the modification results are returned to the client. The modification operation record is used to record the user's modification request, modification operation process and modification results, where the modification operation process includes the operation time and the modifier as the operator.

[0080] In this embodiment, for each piece of business data, the annotation record includes the source of the business data, the generation time, the generator, the operation time and operator of each operation on the business data, and the destination, where the operation includes operations based on data access requests and operations based on service requests.

[0081] The method of this embodiment can realize the traceability of various types of business data stored in the data sharing and exchange platform, and mainly provides two services: data collection and data traceability.

[0082] Data collection: For the business data collected from the data source, data cleaning is performed on various types of business data, and the detected erroneous data is corrected, such as filling missing values, correcting erroneous values, deleting duplicate records, etc. The business data after data cleaning is finally stored in the original module, that is, it flows back to the data sharing and exchange platform; the cleaned business data may not be directly used for sharing and tracing due to differences in format, coding, unit, etc., so data conversion is performed on these business data, and business data in different formats are converted into a unified format. A data conversion mapping table is established to record the rules and processes of data conversion. The pre-processed business data is stored in the original module, that is, the pre-processed business data is integrated into the database of the sharing and exchange platform to form a unified data view; an association relationship is established between business data and metadata, and the association relationship is stored in the original module. A metadata management system is established to uniformly manage and maintain various types of business data and their metadata in the data sharing and exchange platform, and the business data is annotated and recorded. The source, evolution process and destination of the business data are identified through the annotated records, so that data tracing can be performed when necessary.

[0083] Data traceability: Various operations on business data, such as data exchange operations, sharing and mining operations, and service operations are recorded, and the data annotations of business data are updated based on the records. All annotation records generated during data operations are organized into an annotation record chain in chronological order. During the data propagation process, the record chain should move and propagate with the data. Whenever the data is accessed or modified, the record chain will be updated in real time. Based on this record chain, the traceability of business data can be achieved.

[0084] The present invention has been shown and described in detail above through the accompanying drawings and preferred embodiments. However, the present invention is not limited to these disclosed embodiments. Based on the above multiple embodiments, those skilled in the art can know that the means in the above different embodiments can be combined to obtain more embodiments of the present invention, and these embodiments are also within the protection scope of the present invention.

Claims

1. A data tracing system applied to a data sharing and exchange platform, characterized in that: It includes multiple functional modules, namely, front-end module, original module, center module, analysis module, service module and client; The front-end module is used to collect business data from the data source, pre-process the business data, associate the business data with metadata, and send the processed business data, the metadata and annotation records of the business data, and the association between the business data and metadata to the original module, where the annotation records are used to record the source, evolution process and destination of the business data; The original module is used to store processed business data, metadata and origin information of business data, and the relationship between business data and metadata; The central module is used to provide a data access interface for each functional module and a third-party system, receive data access requests through the data access interface, and perform data exchange operations on relevant business data based on the data access requests, record the data exchange process and form a data exchange record, read the business data specified by the data access request from the original module through the data exchange operation and return the business data, and the data exchange record at least includes the destination information of the business data; correspondingly, the original module is used to update the annotation record of the corresponding business data based on the data exchange record; The analysis module is used to obtain business data from the central module, and analyze and mine the business data through the pre-configured analysis and mining algorithm, record the analysis and mining process, analysis and mining algorithm and analysis and mining results, and form a data analysis and mining record; The client provides a user interface for interacting with the user, and is used to receive user requests submitted by the user and forward the user requests to the service module; The service module is used to receive service requests and cooperate with the original module, central module and analysis module to perform service operations. It is used to record the service operation process to form a service operation record and return the response to the service request to the client. Correspondingly, the original module is used to update the annotation records of related business data based on the service operation record.

2. The data tracing system applied to the data sharing and exchange platform according to claim 1 is characterized in that: The front-end module is used to perform the following data preprocessing on the business data and data association between the business data and the metadata: Clean the business data by filling missing values, correcting erroneous values, and reconstructing and deleting records to obtain the cleaned business data. Perform data format conversion on the cleaned business data, convert business data in different formats into a unified format, and establish a data conversion mapping table to record the data format conversion rules and data format conversion process through the data conversion mapping table; For various types of business data, the business data and its metadata are associated with each other, and a metadata management system is established. Through the data management system, various types of business data and their metadata in the shared exchange platform are uniformly managed and maintained, and each piece of business data is annotated and recorded through data annotation.

3. The data tracing system applied to the data sharing and exchange platform according to claim 1 is characterized in that: For each piece of business data, the annotation record includes the source of the business data, generation time, generator, operation time and operator of each operation on the business data, and destination, where the operation includes operations based on data access requests and operations based on service requests.

4. The data tracing system applied to the data sharing and exchange platform according to claim 1 is characterized in that: For the client, the service requests submitted by users include query requests and modification requests; For query requests, the service module cooperates with the original module, the central module and the analysis module to provide query operations, and records the query operation process to form a query operation record. Through the query operation, the record chain, data exchange record and data analysis and mining record of the specified business data in the query request are read to perform the query, and the query result is returned to the client. The query operation record is used to record the user's query request, query operation process and query result, wherein the query operation process includes the query time and the queryer as the operator; For modification requests, the service module cooperates with the original module, the central module and the analysis module to provide modification operations, and records the modification operation process to form a modification operation record. Through the modification operation, the record chain, data exchange record and data analysis and mining record of the specified business data in the modification request are read to make modifications, and the modification results are returned to the client. The modification operation record is used to record the user's modification request, modification operation process and modification results, where the modification operation process includes the operation time and the modifier as the operator.

5. A data tracing method applied to a data sharing and exchange platform, characterized in that: The method is used to realize data traceability through a data traceability system applied to a data sharing and exchange platform according to any one of claims 1 to 4, and the method comprises the following steps: The front-end module collects business data from the data source, pre-processes the business data, and associates the business data with metadata. The processed business data, the metadata and annotation records of the business data, and the association between the business data and metadata are sent to the original module, where the annotation records are used to record the source, evolution process, and destination of the business data; The original module stores the processed business data, the metadata and origin information of the business data, and the association between the business data and the metadata; Receive data access requests through the data access interface provided by the central module, and perform data exchange operations on relevant business data based on the data access requests, record the data exchange process and form a data exchange record, read the business data specified by the data access request from the original module through the data exchange operation and return the business data, and the data exchange record at least includes the destination information of the business data; correspondingly, update the annotation record of the corresponding business data through the original module based on the data exchange record; The analysis module obtains business data from the central module, and analyzes and mines the business data through the pre-configured analysis and mining algorithm, records the analysis and mining process, analysis and mining algorithm and analysis and mining results, and forms a data analysis and mining record; Receive user requests submitted by users through the client and forward the user requests to the service module; In response to user requests, the service module cooperates with the original module, the central module and the analysis module to perform service operations, record the service operation process to form a service operation record, and return a response to the service request to the client; correspondingly, based on the service operation record, the annotation records of the relevant business data are updated through the original module.

6. The data tracing method applied to the data sharing and exchange platform according to claim 5 is characterized in that: Preprocessing the business data and associating the business data with the metadata includes the following steps: Clean the business data by filling missing values, correcting erroneous values, and reconstructing and deleting records to obtain the cleaned business data. Perform data format conversion on the cleaned business data, convert business data in different formats into a unified format, and establish a data conversion mapping table to record the data format conversion rules and data format conversion process through the data conversion mapping table; For various types of business data, the business data and its metadata are associated with each other, and a metadata management system is established. Through the data management system, various types of business data and their metadata in the shared exchange platform are uniformly managed and maintained, and each piece of business data is annotated and recorded through data annotation.

7. The data tracing method applied to the data sharing and exchange platform according to claim 5 is characterized in that: For each piece of business data, the annotation record includes the source of the business data, generation time, generator, operation time and operator of each operation on the business data, and destination, where the operation includes operations based on data access requests and operations based on service requests.

8. The data tracing method applied to the data sharing and exchange platform according to claim 5 is characterized in that: Service requests submitted by users include query requests and modification requests; For query requests, the service module cooperates with the original module, the central module and the analysis module to provide query operations, and records the query operation process to form a query operation record. Through the query operation, the record chain, data exchange record and data analysis and mining record of the specified business data in the query request are read to perform the query, and the query result is returned to the client. The query operation record is used to record the user's query request, query operation process and query result, wherein the query operation process includes the query time and the queryer as the operator; For modification requests, the service module cooperates with the original module, the central module and the analysis module to provide modification operations, and records the modification operation process to form a modification operation record. Through the modification operation, the record chain, data exchange record and data analysis and mining record of the specified business data in the modification request are read to make modifications, and the modification results are returned to the client. The modification operation record is used to record the user's modification request, modification operation process and modification results, where the modification operation process includes the operation time and the modifier as the operator.

Citation Information

Patent Citations

  • Data sharing exchange model and method based on cloud computation

    CN103281368A

  • Data sharing exchange and open application platform

    CN111176867A

  • Government affair data sharing and exchanging method and device

    CN112948383A

  • Government affair data resource integrated management system and method based on big data analysis

    CN117472874A