Block chain multi-source data auditing and branch tracing system and data flow tracing method

Abstract

The invention relates to the technical field of data tracing and verification, in particular to a block chain multi-source data auditing and branch tracing system and a data circulation tracing method. The system comprises a service system layer, a trusted network layer and a block chain network layer, the business system layer is used for generating and using data; the trusted network layer is provided with an auxiliary database; the trusted network layer interacts with the business system layer and the block chain network layer; the trusted network layer is used for processing data submitted by the service system layer, analyzing data circulation information, extracting node information and a relation and storing the node information and the relation in an auxiliary database; the node information comprises a data flow address, an operator, an operation mode and time; the relationship is used for describing a data circulation direction; and the trust network layer also constructs a block chain transaction in combination with the data circulation information and uploads the block chain transaction to the block chain network layer. According to the method, full-life-cycle tracking of the data resources is realized, the source and the flow direction of each data resource / product can be clearly seen, and traceability and full-process auditing of data fusion products are supported.

Description

Technical Field

[0001] The present invention relates to the field of data tracing and verification technology, and in particular to a blockchain multi-source data auditing and branch tracing system and a data flow tracing method. Background Art

[0002] As enterprises deepen their digital transformation, business data is becoming multi-source, complex, and branching. Data from various systems undergoes multiple processing and transformations, and business processes involve multiple conditional branches, making full-process data auditing both crucial and complex. Blockchain technology, with its immutability, distributed storage, and consensus mechanisms, is an ideal choice for trusted data auditing.

[0003] Currently, blockchain has multiple implementation methods for data auditing, including full on-chain, hash on-chain, hybrid storage, and integration with distributed storage systems. Full on-chain records all data completely on the blockchain and is suitable for scenarios with small data volumes; hash on-chain only stores the data hash value on-chain, storing the complete data in a traditional database, balancing storage efficiency and verification requirements; and hybrid models select different storage methods based on data importance to optimize resource utilization.

[0004] However, existing blockchain audit systems mostly use a chain-like structure to record data, primarily suited to auditing and tracing linear business processes. This structure faces significant challenges when handling complex scenarios with multiple sources and branches in actual enterprise applications, specifically in the following aspects:

[0005] 1. Existing blockchain data auditing technology has significant shortcomings when dealing with complex business environments. The linear ledger structure of traditional blockchains makes it difficult to naturally express the complex network of relationships between multi-source data, resulting in unclear data traceability. When a report references multiple data sources, existing systems often only record the hash value of the final report, failing to effectively link and verify all original data sources.

[0006] 2. Existing technologies typically only capture the actual execution path when recording business processes, lacking a complete record of conditional branches. In scenarios requiring rigorous audits, such as financial approvals and medical diagnoses, understanding "why a decision was made" is as important as knowing "what was done." However, existing systems struggle to provide this in-depth audit capability. Summary of the Invention

[0007] In order to overcome the defects of the above-mentioned existing technologies in expressing multi-source data relationships and tracking business branches, the present invention proposes a blockchain multi-source data audit and branch tracing system, which parses and stores data flow, realizes the full life cycle tracking of data resources, and can clearly see the source and flow of each data resource / product, supporting the traceability and full-process audit of data fusion products.

[0008] The present invention proposes a blockchain multi-source data audit and branch tracing system, which includes a business system layer, a trusted network layer, and a blockchain network layer;

[0009] The business system layer is used to generate and use data; the trusted network layer has an auxiliary database; the trusted network layer interacts with the business system layer and the blockchain network layer respectively;

[0010] The trust network layer is used to process data submitted by the business system layer, parse data flow information, extract node information and relationships, and store them in the auxiliary database; node information includes data flow address, operator, operation method and time; relationships are used to describe the direction of data flow;

[0011] The trust network layer also combines data flow information to construct blockchain transactions and upload them to the blockchain network layer.

[0012] Preferably, the trust network layer includes an off-chain layered architecture, an off-chain logic module, and an interactive interface layer; the interactive interface layer is used to support the interaction between the trusted network layer, the business system layer, and the blockchain network layer;

[0013] The auxiliary database is set up in an off-chain layered architecture;

[0014] The off-chain logic module includes a data center, a verification engine, and a transaction construction unit;

[0015] The data center is used to process data submitted by the business system layer, analyze data flow information and store it in the auxiliary database;

[0016] The transaction construction unit combines to construct blockchain transactions and stores them on-chain.

[0017] The verification engine combines blockchain data to perform on-chain verification of the information in the auxiliary database.

[0018] Preferably, data flow information is marked with importance levels, and all data marked as "important" level is stored on the chain; data marked as "less important" level is stored on the chain with a hash value.

[0019] Preferably, the auxiliary database includes two sub-tables, sub-table one is used to store node information, and sub-table two is used to store relationships.

[0020] Preferably, the blockchain network layer uses a KV structure to store data.

[0021] Preferably, the blockchain network layer adopts distributed ledger technology, and its node network is composed of multiple consensus nodes.

[0022] The present invention proposes a data flow tracing method based on blockchain, which first receives a full-process audit request or a traceability request, determines the node information corresponding to the requester in the auxiliary database, performs relationship extraction, identifies the dependency relationship between the data before and after the node, and obtains the data tracking path; performs on-chain verification on the information and relationship of each node on the path, generates a verification report and outputs it.

[0023] Preferably, after receiving a full-process audit request or a traceability request, the node information and tracing depth corresponding to the requester are parsed, and the length of the longest branch traced is the tracing depth.

[0024] The present invention proposes a storage medium storing a computer program, which, when executed, is used to implement the blockchain-based data flow tracing method.

[0025] The advantages of the present invention are:

[0026] (1) The blockchain multi-source data audit and branch tracing system proposed in this invention uses an auxiliary database to store data flow information offline, track data resources, record the data transmission path between different participants, form a complete chain of responsibility, facilitate the identification of abnormal situations in data sharing and use, and improve audit efficiency. The present invention is particularly suitable for complex data ecosystems and can effectively solve problems such as unknown data sources and improper use, ensuring the security and compliance of data sharing.

[0027] (2) The trusted network layer in the present invention provides offline storage of data flow information, which provides a solid technical foundation for the business system layer, makes the auditing and branch tracing of multi-source data possible, effectively solves the trust problem in traditional data sharing, and provides technical guarantees for the safe sharing and effective use of data.

[0028] (3) This invention constructs a data relationship graph model based on relational hash links by extracting relationships between data. This model can accurately record and verify the kinship and dependency relationships between data from different systems and business processes. By calculating and verifying relational hash values, this technology ensures the immutability of data relationships and enables trusted auditing of complex data networks.

[0029] (4) The present invention significantly improves audit efficiency and reduces costs. The system can automatically construct data relationship maps, reproduce business processing paths, and verify data, reducing a large amount of manual analysis work. This highly automated audit process not only improves audit accuracy and reduces the error rate, but also shortens the audit cycle. It provides strong technical support for enterprises to meet increasingly stringent data compliance requirements, making data management and audit work more efficient and reliable.

[0030] (5) This invention also proposes a data hierarchical storage strategy. Based on data importance and audit requirements, it adopts a hybrid model of fully uploading critical data to the chain and hashing general data to the chain. It also designs a complete on-chain and off-chain data consistency verification mechanism. This mechanism significantly improves the system's storage efficiency and query performance while ensuring data credibility.

[0031] (6) This invention achieves a highly trusted data audit environment through blockchain technology. The tamper-proof nature of blockchain is leveraged to ensure the authenticity and reliability of audit data. A hash verification mechanism is used to ensure the integrity of data content and transaction processes. Furthermore, a collaborative storage strategy between on-chain and off-chain storage optimizes storage resource utilization, balancing security and efficiency and resolving data credibility issues in traditional audit systems.

[0032] (7) The present invention extracts node information and can save the mechanism and operation results of each decision point by recording the judgment conditions, input parameters, and selection basis of each decision point. It also records the conditional branches through relational storage, thereby constructing a complete conditional branch tree structure, allowing complex business processes to be fully restored and verified, fundamentally solving the problem of "knowing what happened but not why" in traditional audits. That is, the present invention's complete recording of the conditional branches of the business process not only captures "what was done", but also records the decision basis of "why it was done", greatly improving the depth and explainability of the audit, making the restoration and verification of complex business processes possible.

[0033] (8) The blockchain-based data flow tracing method proposed in this invention has made a breakthrough in solving the auditing problems of multi-source data and complex business processes. The present invention supports the recording and verification of complex data relationship networks through the blockchain multi-source data audit and branch tracing system, and displays the complete data lineage relationship through the relationship graph model, thus realizing comprehensive data traceability and full-process auditing. When tracing data, the present invention uses an auxiliary database for offline tracing and then performs on-chain verification, taking into account both data tracing efficiency and authenticity verification, and ensuring the reliability of the tracing results.

[0034] (9) The system and method of the present invention combine to include an automated audit engine that can automatically construct data relationship maps, reproduce business processing paths, and verify data consistency. This method significantly improves audit efficiency and reduces the workload and error rate of manual audits. BRIEF DESCRIPTION OF THE DRAWINGS

[0035] Figure 1 This is a schematic diagram of a blockchain multi-source data audit and branch tracing system proposed by the present invention;

[0036] Figure 2 This is the business layer structure diagram of the data sharing system;

[0037] Figure 3It is a multi-branch audit business diagram;

[0038] Figure 4 Flowchart for data evidence storage;

[0039] Figure 5 Data tracing process. DETAILED DESCRIPTION

[0040] The following will provide a clear and complete description of the technical solutions in the embodiments of the present invention in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments of the present invention without making any creative efforts shall fall within the scope of protection of the present invention.

[0041] like Figure 1 As shown, a blockchain multi-source data audit and branch tracing system includes a business system layer, a trusted network layer and a blockchain network layer.

[0042] The business system layer is the source of data production and use, including multiple independent business systems, such as Figure 2 The data sharing system shown in the figure, etc. The business system is the application layer that users interact directly with and is used to independently generate business data, which includes structured data and unstructured data.

[0043] At the business system level, data flows from providers to exchange centers, undergoing necessary processing before being transferred to users. The entire process is overseen by the shared management platform, which ensures the standardization of data sharing through management and auditing functions.

[0044] The business system layer supports the visualization of multi-dimensional audit data.

[0045] In practice, the business system layer provides three audit views: a data source tracking diagram, an authorization chain display, and a data verification report, for monitoring the complete data lifecycle. This business-layer design makes the data sharing process transparent and traceable, enabling all participants to exchange and use data securely and efficiently under unified rules, providing reliable technical support for cross-organizational data collaboration.

[0046] Business flow can refer to the following Figure 3The data business process is divided horizontally into five business stages: resource registration, resource release, resource delivery, product release, and product delivery; vertically, it is divided into five categories according to the participating entities: data provider A, data provider B, data operator C, data user D, and data user E. The data resources in the process (marked with a1, a2, b1, etc.) flow from left to right, showing the complete life cycle of data from creation to final use. For example, resources a1 and a2 created by data provider A are registered and released, and then acquired by data operator C. The operator processes these resources, creates new products c1 and c2, and releases them. These products are eventually acquired and used by data users D and E.

[0047] The trusted network layer is the core component of this invention. It serves as a bridge between the business system and the blockchain and is responsible for data management, relationship building, and audit queries.

[0048] The business system layer interacts with the trusted network layer through the data submission interface and the audit query interface. The trusted network layer interacts with the blockchain network layer through the blockchain interface.

[0049] The trusted network layer includes: off-chain layered architecture, off-chain logic modules, and interactive interface layer. The interactive interface layer is used to support data submission interface, audit query interface, and blockchain interface.

[0050] The off-chain layered architecture includes an auxiliary database, which is used to store data flow information. Data flow information includes node information and relationships. Node information includes the data flow address, operator, operation method, and time. Relationships are used to describe the direction of data flow. Specifically, the auxiliary database contains two sub-tables: sub-table 1 stores node information, and sub-table 2 stores relationships.

[0051] The off-chain layered architecture extracts and stores relationships between data to form a relational graph model, maintaining the kinship between multi-source data. The relational graph model is essentially a topological network model with data flow addresses as nodes and relationships as edges. Nodes are associated with node information, such as the data operator, operation time, and method.

[0052] The off-chain logic module includes a data center, a verification engine, and a transaction construction unit;

[0053] The data center is used to process data submitted by the business system layer, parse data flow information, extract node information and relationships, and store them in the auxiliary database.

[0054] The transaction construction unit combines the data flow information obtained by the data center to construct a blockchain transaction and submits it to the blockchain through the blockchain interface for on-chain storage.

[0055] The verification engine performs data consistency and relational integrity verification on the information in the auxiliary database, specifically combining blockchain data for on-chain verification.

[0056] Specifically, during the data processing process, the data center also marks the importance level of the data based on the data operator, data operation method, etc.; the transaction construction unit stores all important data on the chain, and only stores the hash value of the secondary data on the chain.

[0057] The trusted network layer provides a solid technical foundation for the business system layer, making the auditing and branch tracing of multi-source data possible, effectively solving the trust issues in traditional data sharing, and providing technical guarantees for the safe sharing and effective use of data.

[0058] The blockchain network layer is composed of multiple blockchain nodes, providing tamper-proof data storage and verification services, and is the basic guarantee for data credibility.

[0059] The blockchain network layer, serving as the security foundation for the entire system, employs a hybrid architecture of on-chain verification and off-chain storage to ensure the credibility and traceability of data flows throughout the entire process. This layer's design fully considers the balance between the characteristics of blockchain storage and query efficiency, making it particularly suitable for multi-branch auditing scenarios.

[0060] The blockchain network layer uses multiple consensus nodes to form a node network, implementing a distributed consensus blockchain and ensuring data consistency through distributed ledger technology. Each consensus node runs chain services to avoid single points of failure, execute contract operations, and maintain the security and consistency of the blockchain network.

[0061] In this way, the present invention combines an auxiliary database with on-chain storage, achieving a balanced balance of performance and security. The auxiliary database stores raw data and related index information, working closely with the logical service to provide efficient data query and storage capabilities. The blockchain also provides distributed storage for ownership confirmation and traceability information, ensuring data immutability and traceability.

[0062] In this system, only the hash information required for verification is stored on the chain, reducing storage costs; complex queries are executed in the auxiliary database off-chain to improve query efficiency; and the consistency of off-chain data and on-chain proofs is regularly verified through the verification engine.

[0063] Since each child node in the data relationship graph has only one parent node, there is only one path for data tracing. However, a full-process audit may have multiple branches.

[0064] Reference Figure 5 The data flow tracing method based on blockchain proposed in the present invention, when used for full-process audit, includes the following steps:

[0065] St1. Receive a full-process audit request, determine the node information corresponding to the requester in the auxiliary database as the target node, and construct a tracking path based on the address of the target node and the data flow information stored in the auxiliary database, that is, use the target node as the parent node for branch tracking and find the path.

[0066] St2: Verify the information and relationships of each node on the path on the chain to determine the legitimacy and integrity of the data conversion;

[0067] St3. Generate a visual verification report based on the verification results to display the verification results of each link, that is, to show whether the information of each node on the path in the auxiliary database has been tampered with, lost, or other abnormal situations.

[0068] In a specific embodiment, the operation process of the blockchain multi-source data audit and branch tracing system is shown in the following steps S1-S5. Figure 4 、 Figure 5 A partial flow chart.

[0069] S1: system initialization;

[0070] S11, blockchain network initialization;

[0071] S111. Deploy a distributed node network and configure inter-node communication protocols and consensus mechanisms;

[0072] S112. Deployment of smart contract systems, including ownership confirmation contracts, traceability contracts, and verification contracts;

[0073] S113. Set storage engine parameters and configure KV structure storage rules;

[0074] S12, trusted network layer initialization;

[0075] S121. Establish auxiliary database table structures, including entities, entity_transformations, flow_definitions, and other tables;

[0076] S122. Configure a data tiered storage strategy to determine the storage location and method based on data importance.

[0077] S123. Initialize the relationship graph model and set the basic properties of nodes and edges; nodes are addresses extracted from node information, and edges are relationships.

[0078] S13, business system layer interface initialization;

[0079] S131. Configure a standardized data submission interface, including data format specifications and authentication methods;

[0080] S132. Set up the audit query interface and define the query parameters and result format;

[0081] S133. Initialize the audit view display component and configure data visualization parameters.

[0082] S2: Data inbound processing;

[0083] S21, data preprocessing;

[0084] S211. Receive original data submitted by the business system and verify data integrity and format compliance;

[0085] S212. Extract data metadata, including source, timestamp, business type, etc.

[0086] S213. Calculate the data hash value as the unique identifier of the data;

[0087] S22, data classification storage;

[0088] S221. Determine the storage strategy based on the importance of the data. Fully upload critical data to the blockchain, and hash general data to the blockchain.

[0089] S222. Encrypt key data to protect sensitive information;

[0090] S223, storing the data and meta information in the auxiliary database and updating the entities table;

[0091] S23, data on-chain ownership confirmation;

[0092] S231. Construct a data rights confirmation transaction, including data hash, metadata hash, and signature information;

[0093] S232. Submit the transaction to the blockchain network and verify the validity of the transaction through the consensus mechanism;

[0094] S233. After the transaction is confirmed, the transaction hash and block height are obtained and the blockchain_nodes table is updated.

[0095] S3: Relationship building and recording;

[0096] S31, identifying data relationships;

[0097] S311. Analyze the reference relationships in the business data and identify the dependencies and derivation relationships between the data;

[0098] S312. Generate a data conversion description based on the data processing logic;

[0099] S313. Verify the legitimacy of the relationship to ensure compliance with predefined business rules;

[0100] S32, record the business branch process;

[0101] S321. Capture decision points during business processing and record judgment conditions and selection basis;

[0102] S322. Build a conditional branch tree and mark the execution path and status of each branch;

[0103] S323. Store the branch flow description information into the flow_branches table;

[0104] S33, relationship on-chain evidence storage;

[0105] S331. Build a relationship transaction, including the source node ID, target node ID, and relationship type;

[0106] S332, calculating the relationship hash value, which is generated based on the source node, the target node and the relationship attributes;

[0107] S333. Submit the relationship transaction to the blockchain and update the entity_transformations table status.

[0108] S4: Audit Query and Verification;

[0109] S41, initializing the audit request;

[0110] S411. Receive user audit query request and verify user authority;

[0111] S412. Parse the query parameters to determine the audit scope and depth;

[0112] S413. Select an appropriate audit strategy based on the query type;

[0113] S42, multi-branch path tracing;

[0114] S421. Starting from the target node, a traceability path is constructed through the entity_transformations table. S422. Branch nodes are identified and the complete decision tree is restored.

[0115] S423. Extract the business data and processing logic of each node and reconstruct the complete business process;

[0116] S43, data and relationship verification;

[0117] S431. Perform on-chain verification on each node on the path to confirm that the data has not been tampered with.

[0118] S432: Verify the legitimacy of the relationships between nodes to ensure compliance with the rules in flow_definitions. S433: Check the integrity of the business branch process and verify the judgment logic of the decision point.

[0119] S44, generate an audit report;

[0120] S441. Summarize the verification results and mark the verification status (pass / fail);

[0121] S442. Build a visual audit map to show data lineage and business processes;

[0122] S443. Generate a detailed audit report including data source, processing history and verification proof.

[0123] S5: exception handling and alarm;

[0124] S51, data anomaly detection;

[0125] S511. Detect data hash mismatch and mark data that may have been tampered with.

[0126] S512. Identify unauthorized data access and usage;

[0127] S513: Detecting data relationship anomalies, such as missing key nodes or illegal relationships;

[0128] S52, business rule violation detection;

[0129] S521. Check whether the business process complies with predefined rules;

[0130] S522. Verify the integrity and validity of the authorization chain;

[0131] S523. Verify whether data processing complies with compliance requirements;

[0132] S53, Alarm and Response;

[0133] S531. Generate an exception alarm, including the exception type, severity, and impact range;

[0134] S532. Record abnormal events in the audit log for subsequent analysis;

[0135] S533. Trigger a predefined response process, such as notifying relevant responsible persons or suspending relevant operations.

[0136] Of course, it will be apparent to those skilled in the art that the present invention is not limited to the details of the exemplary embodiments described above, but also encompasses the same or similar structures that can be implemented in other specific forms without departing from the spirit or essential characteristics of the invention. Therefore, the embodiments should be considered in all respects as illustrative and non-restrictive, and the scope of the invention is defined by the appended claims, not the foregoing description, and it is intended that all variations that fall within the meaning and range of equivalents of the claims be encompassed within the present invention. Any reference signs in the claims should not be construed as limiting the claim to which they relate.

[0137] In addition, it should be understood that although this specification is described in terms of implementation methods, not every implementation method contains only one independent technical solution. This narrative method of the specification is only for the sake of clarity. Those skilled in the art should regard the specification as a whole. The technical solutions in each embodiment can also be appropriately combined to form other implementation methods that can be understood by those skilled in the art.

[0138] The technology, shape, and structure not described in detail in the present invention are all well-known technologies.

Claims

1. A blockchain multi-source data audit and branch tracing system, characterized by: Includes business system layer, trusted network layer and blockchain network layer; The business system layer is used to generate and use data; the trusted network layer has an auxiliary database; the trusted network layer interacts with the business system layer and the blockchain network layer respectively; The trust network layer is used to process data submitted by the business system layer, parse data flow information, extract node information and relationships, and store them in the auxiliary database; node information includes data flow address, operator, operation method and time; relationships are used to describe the direction of data flow; The trust network layer also combines data flow information to construct blockchain transactions and upload them to the blockchain network layer.

2. The blockchain multi-source data audit and branch tracing system according to claim 1, characterized in that: The trust network layer includes the off-chain layered architecture, off-chain logic modules, and the interactive interface layer; the interactive interface layer is used to support the interaction between the trusted network layer, the business system layer, and the blockchain network layer; The auxiliary database is set up in an off-chain layered architecture; The off-chain logic module includes a data center, a verification engine, and a transaction construction unit; The data center is used to process data submitted by the business system layer, analyze data flow information and store it in the auxiliary database; The transaction construction unit combines to construct blockchain transactions and stores them on-chain. The verification engine combines blockchain data to perform on-chain verification of the information in the auxiliary database.

3. The blockchain multi-source data audit and branch tracing system according to claim 2, characterized in that: Data flow information is marked with importance levels. Data marked as "important" is stored on the chain; data marked as "less important" is stored on the chain with a hash value.

4. The blockchain multi-source data audit and branch tracing system according to claim 2, characterized in that: The auxiliary database contains two sub-tables, sub-table one is used to store node information, and sub-table two is used to store relationships.

5. The blockchain multi-source data audit and branch tracing system according to claim 1, characterized in that: The blockchain network layer uses the KV structure to store data.

6. The blockchain multi-source data audit and branch tracing system according to any one of claims 1 to 5, characterized in that: The blockchain network layer uses distributed ledger technology, and its node network consists of multiple consensus nodes.

7. A data flow tracing method based on blockchain using the blockchain multi-source data audit and branch tracing system according to any one of claims 1 to 6, characterized in that: First, it receives a full-process audit request or traceability request, determines the node information corresponding to the requester in the auxiliary database, and performs relationship extraction to identify the dependency between the data before and after the node and obtain the data tracking path; Perform on-chain verification on each node information and relationship on the path, generate a verification report and output it.

8. The data flow tracing method based on blockchain according to claim 7 is characterized in that: After receiving a full-process audit request or a traceability request, the node information and tracing depth corresponding to the requester are parsed. The length of the longest branch traced is the tracing depth.

9. A storage medium, characterized in that: A computer program is stored, which, when executed, is used to implement the blockchain-based data flow tracing method as described in claim 7 or 8.

Images