A public data product traceability management method and system

Abstract

This invention discloses a method and system for traceability management of public data products, belonging to the field of big data information management technology. It includes identifier generation, on-chain evidence storage, watermark embedding, compliance verification, traceability query, and anomaly handling. This invention extracts metadata from original public data to generate a globally unique data identifier (DID); then, it uploads the data's hash value and operation logs to the blockchain, utilizing a consortium blockchain to achieve cross-institutional, decentralized, and trusted traceability; the entire process of data desensitization, fusion, modeling, and encapsulation is automatically uploaded to the blockchain, recording the operating entity, algorithm, parameters, and timestamp; simultaneously, a lightweight semantic watermark is embedded, containing the DID, chain address, version number, and authorization code; upon receiving traceability requests, the system extracts the watermark and queries the blockchain in parallel, compares consistency, automatically verifies compliance, and generates a traceability report; it monitors access / download / redistribution behavior in real time, constructs a node-operation-time traceability graph in case of anomalies, quickly locates the responsible entity, and automatically handles the issue.

Description

Technical Field

[0001] This invention relates to a method and system for tracing and managing public data products, belonging to the field of big data information management technology. Background Technology

[0002] As a professional term, public data is defined at its core as the collection of data collected and generated by entities and organizations in the course of fulfilling their public management responsibilities or providing public services in accordance with the law. Public data encompasses both structured and unstructured data generated in fields such as administration, education, healthcare, transportation, and environmental protection. In practice, public data achieves secure and compliant circulation and value release through classified and graded management and dynamic security mechanisms.

[0003] However, existing public data products suffer from technical problems such as incomplete traceability throughout the entire lifecycle, unclear ownership, difficulty in compliance review, and difficulty in determining responsibility.

[0004] Therefore, the present invention proposes a new solution. Summary of the Invention

[0005] The main objective of this invention is to address the shortcomings of existing technologies by providing a public data product traceability management method and system.

[0006] The objective of this invention can be achieved by adopting the following technical solution:

[0007] A method and system for tracing and managing public data products, comprising:

[0008] S1. Generate identifiers: Establish a public data traceability management platform through blockchain technology, then extract and standardize metadata from public data sources, and generate globally unique data identifiers (DIDs).

[0009] S2. On-chain evidence storage: The hash value of the data and the operation log are stored on the blockchain for evidence storage.

[0010] S3. Embed watermarks to automatically record and upload data processing, desensitization, fusion and encapsulation processes to the blockchain, while embedding lightweight semantic watermarks containing DID and chain address;

[0011] S4. Compliance verification: Receive data product distribution requests, complete authorization verification, and upload authorization information to the blockchain to bind hash values, watermarks, and blockchain addresses.

[0012] S5. Source tracing query: Receives source tracing requests, extracts hash values ​​and watermarks in parallel, queries the blockchain, completes consistency verification and compliance judgment, and outputs the source tracing path;

[0013] S6. Anomaly Handling: Real-time monitoring of data usage behavior; when an anomaly occurs, constructing a source tracing map, locating the responsible node, and performing closed-loop automatic handling of the anomaly.

[0014] Preferably, the on-chain evidence storage module in S2 adopts a consortium blockchain, with nodes including data providers, processors, regulators, and users, and the consensus mechanism is PBFT.

[0015] Preferably, the watermark in S3 is a semantic watermark that is desensitized and compatible, has low distortion, and can be extracted blindly, without affecting data availability and statistical characteristics.

[0016] Preferably, the consistency verification and compliance judgment content in S5 includes: data security level, usage matching degree, de-identification integrity, authorization validity period, and regional or departmental permissions.

[0017] Preferably, abnormal behaviors in S6 include: unauthorized access, unauthorized secondary distribution, tampering, use beyond the scope, and high-frequency batch crawling.

[0018] Preferably, the closed-loop automatic processing in S6 includes: authorization revocation, access blocking, account freezing, and evidence preservation.

[0019] A public data product traceability management system includes:

[0020] The identifier management module is used for DID generation and metadata standardization;

[0021] The on-chain evidence storage module is used to upload the hash value of data and operation logs to the blockchain.

[0022] The watermark tracing module is used for embedding, extracting, and verifying watermarks.

[0023] The compliance verification module is used for the rules engine and automated auditing.

[0024] The source tracing module is used for one-click source tracing and report output;

[0025] The anomaly handling module is used for behavior monitoring, map localization, and automatic handling.

[0026] The modules work together to implement a public data product traceability management method.

[0027] Preferably, it also includes an interface adaptation module to support connection with government data sharing platforms, data open platforms, and big data platforms.

[0028] Preferably, the anomaly handling module constructs a source tracing graph through a graph database, supporting multi-dimensional backtracking by subject, operation, time, and IP.

[0029] A computer-readable storage medium stores a computer program that, when executed by a processor, implements the aforementioned method for traceability management of public data products.

[0030] The beneficial technical effects of this invention are as follows: According to the public data product traceability management method and system of this invention, metadata is extracted from the original public data to generate a globally unique data identifier (DID), which is then bound to the data source, format, security level, and collection time. The hash value and operation log of the data are then uploaded to the blockchain, utilizing a consortium blockchain to achieve cross-institutional, decentralized, and trusted traceability. The entire process of data desensitization, fusion, modeling, and encapsulation is automatically uploaded to the blockchain, recording the operating entity, algorithm, parameters, and timestamp. Simultaneously, a lightweight semantic watermark is embedded, containing the DID, chain address, version number, and authorization code. When providing data externally, an authorization certificate is generated, binding the hash value and watermark information to the on-chain block address to ensure manageable distribution. Upon receiving traceability requests, the watermark is extracted and the blockchain is queried in parallel, comparing consistency, automatically verifying compliance, and generating a traceability report. Real-time monitoring of access / download / secondary distribution behavior is conducted; in case of anomalies, a node-operation-time traceability graph is constructed to quickly locate the responsible entity and automatically handle the situation. Attached Figure Description

[0031] Figure 1 A flowchart of a preferred embodiment provided by the present invention;

[0032] Figure 2 This is a system architecture diagram according to a preferred embodiment of the present invention; Detailed Implementation

[0033] To enable those skilled in the art to understand the technical solution of the present invention more clearly, the present invention will be further described in detail below with reference to the embodiments and accompanying drawings, but the embodiments of the present invention are not limited thereto.

[0034] like Figures 1-2 As shown, the public data product traceability management method and system provided in this embodiment include:

[0035] S1. Generate identifiers: Establish a public data traceability management platform through blockchain technology, then extract and standardize metadata from public data sources, and generate globally unique data identifiers (DIDs).

[0036] S2. On-chain evidence storage: The hash value of the data and the operation log are stored on the blockchain for evidence storage.

[0037] S3. Embed watermarks to automatically record and upload data processing, desensitization, fusion and encapsulation processes to the blockchain, while embedding lightweight semantic watermarks containing DID and chain address;

[0038] S4. Compliance verification: Receive data product distribution requests, complete authorization verification, and upload authorization information to the blockchain to bind hash values, watermarks, and blockchain addresses.

[0039] S5. Source tracing query: Receives source tracing requests, extracts hash values ​​and watermarks in parallel, queries the blockchain, completes consistency verification and compliance judgment, and outputs the source tracing path;

[0040] S6. Anomaly Handling: Real-time monitoring of data usage behavior; when an anomaly occurs, constructing a source tracing map, locating the responsible node, and performing closed-loop automatic handling of the anomaly.

[0041] The on-chain evidence storage module in S2 uses a consortium blockchain, with nodes including data providers, processors, regulators, and users, and the consensus mechanism is PBFT.

[0042] The watermark in S3 is a semantic watermark that is desensitized, compatible, low-distortion, and can be extracted blindly, without affecting data availability and statistical characteristics.

[0043] The consistency verification and compliance judgment in S5 include: data security level, usage matching degree, de-identification integrity, authorization validity period, and regional or departmental permissions.

[0044] Abnormal behaviors in S6 include: unauthorized access, unauthorized secondary distribution, tampering, use beyond the scope, and high-frequency batch crawling.

[0045] The closed-loop automatic processing in S6 includes: authorization revocation, access blocking, account freezing, and evidence preservation.

[0046] A public data product traceability management system includes:

[0047] The identifier management module is used for DID generation and metadata standardization;

[0048] The on-chain evidence storage module is used to upload the hash value of data and operation logs to the blockchain.

[0049] The watermark tracing module is used for embedding, extracting, and verifying watermarks.

[0050] The compliance verification module is used for the rules engine and automated auditing.

[0051] The source tracing module is used for one-click source tracing and report output;

[0052] The anomaly handling module is used for behavior monitoring, map localization, and automatic handling.

[0053] It also includes an interface adaptation module to support integration with government data sharing platforms, data open platforms, and big data platforms.

[0054] The anomaly handling module constructs a source tracing graph through a graph database, supporting multi-dimensional backtracking by subject, operation, time, and IP.

[0055] A computer-readable storage medium for storing a computer program, the method of which is implemented when the program is executed by a processor.

[0056] This application extracts metadata from raw public data to generate a globally unique data identifier (DID), binding it to the data source, format, security level, and collection time. Then, it uploads the data's hash value and operation logs to the blockchain, utilizing a consortium blockchain to achieve cross-institutional, decentralized, and trusted traceability. The entire process of data anonymization, fusion, modeling, and encapsulation is automatically uploaded to the blockchain, recording the operating entity, algorithm, parameters, and timestamp. Simultaneously, a lightweight semantic watermark is embedded, containing the DID, chain address, version number, and authorization code. When providing data externally, an authorization certificate is generated, binding the hash value and watermark information to the on-chain block address to ensure manageable distribution. Upon receiving traceability requests, the application extracts the watermark and queries the blockchain in parallel, comparing consistency, automatically verifying compliance, and generating a traceability report. It monitors access / download / redistribution behavior in real time, constructing a node-operation-time traceability graph in case of anomalies to quickly locate the responsible party and automatically handle the situation.

[0057] Example 1: Method

[0058] Collect data on people's livelihood, extract metadata and generate DID.

[0059] On-chain evidence storage: The hash value of the data and operation logs are stored on the blockchain for evidence storage.

[0060] The processing is recorded on the blockchain, embedding a watermark containing hash value, DID, and blockchain information.

[0061] Once an enterprise applies to access the data and authorization is granted, the data is uploaded to the blockchain and a watermark is attached.

[0062] Regulatory traceability: Extract watermark → Locate block → Reconstruct the entire process → Output compliance report.

[0063] An alarm is triggered when unauthorized access is detected. A map is generated to locate the account and its operation trajectory, and the situation is handled automatically.

[0064] Example 2: System

[0065] The system is deployed on the government cloud and adopts a microservice architecture.

[0066] Chain nodes: Big Data Bureau, Government Service Center, Regulatory Departments, Third-party Institutions;

[0067] Watermarking module: compatible with structured / unstructured data;

[0068] Compliance Engine: Built-in rules related to the management of open public data;

[0069] External API: Provides interfaces for authorization, distribution, traceability, and verification.

[0070] Contents not described in detail in this specification are existing technologies known to those skilled in the art. Standard parts used in this invention can be purchased commercially, and irregularly shaped parts can be custom-made according to the description and drawings. The specific connection methods for each part all employ conventional methods such as bolts, rivets, and welding, which are already mature technologies. The machinery, parts, and equipment all use conventional models from the prior art, and the circuit connections also employ conventional connection methods from the prior art, which will not be detailed here.

[0071] Although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art can still modify the technical solutions described in the foregoing embodiments or make equivalent substitutions for some of the technical features. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of the present invention should be included within the protection scope of the present invention.

Claims

1. A method for traceability management of public data products, characterized in that, include: S1. Generate identifiers: Establish a public data traceability management platform through blockchain technology, then extract and standardize metadata from public data sources, and generate globally unique data identifiers (DIDs). S2. On-chain evidence storage: The hash value of the data and the operation log are stored on the blockchain for evidence storage. S3. Embed watermarks to automatically record and upload data processing, desensitization, fusion and encapsulation processes to the blockchain, while embedding lightweight semantic watermarks containing DID and chain address; S4. Compliance verification: Receive data product distribution requests, complete authorization verification, and upload authorization information to the blockchain to bind hash values, watermarks, and blockchain addresses. S5. Source tracing query: Receives source tracing requests, extracts hash values ​​and watermarks in parallel, queries the blockchain, completes consistency verification and compliance judgment, and outputs the source tracing path; S6. Anomaly Handling: Real-time monitoring of data usage behavior; when an anomaly occurs, constructing a source tracing map, locating the responsible node, and performing closed-loop automatic handling of the anomaly.

2. The method for traceability management of public data products according to claim 1, characterized in that, The on-chain evidence storage module in S2 uses a consortium blockchain, with nodes including data providers, processors, regulators, and users, and the consensus mechanism is PBFT.

3. The method for traceability management of public data products according to claim 1, characterized in that, The watermark in S3 is a semantic watermark that is desensitized, compatible, low-distortion, and can be extracted blindly, without affecting data availability and statistical characteristics.

4. The public data product traceability management method according to claim 1, characterized in that, The consistency verification and compliance judgment in S5 include: data security level, usage matching degree, de-identification integrity, authorization validity period, and regional or departmental permissions.

5. A method for traceability management of public data products according to claim 1, characterized in that, Abnormal behaviors in S6 include: unauthorized access, unauthorized secondary distribution, tampering, use beyond the scope, and high-frequency batch crawling.

6. The method for traceability management of public data products according to claim 1, characterized in that, The closed-loop automatic processing in S6 includes: authorization revocation, access blocking, account freezing, and evidence preservation.

7. A public data product traceability management system, characterized in that, include: The identifier management module is used for DID generation and metadata standardization; The on-chain evidence storage module is used to upload the hash value of data and operation logs to the blockchain. The watermark tracing module is used for embedding, extracting, and verifying watermarks. The compliance verification module is used for the rules engine and automated auditing. The source tracing module is used for one-click source tracing and report output; The anomaly handling module is used for behavior monitoring, map localization, and automatic handling. Each module works in concert to execute the public data product traceability management method as described in any one of claims 1 to 6.

8. The public data product provenance management system of claim 7, wherein, It also includes an interface adaptation module to support integration with government data sharing platforms, data open platforms, and big data platforms.

9. The public data product provenance management system of claim 7, wherein, The anomaly handling module constructs a source tracing graph through a graph database, supporting multi-dimensional backtracking by subject, operation, time, and IP.

10. A computer readable storage medium storing a computer program, characterized in that, When the program is executed by the processor, it implements the public data product traceability management method according to any one of claims 1 to 6.

Images