Blockchain multi-source data auditing and branch tracing system and data flow tracing method

Abstract

The present application relates to the technical field of data tracing and verification, and in particular to a blockchain multi-source data auditing and branch tracing system and a data flow tracing method.The system of the present application comprises a business system layer, a trusted network layer and a blockchain network layer; the business system layer is used to generate and use data; the trusted network layer is provided with an auxiliary database; the trusted network layer interacts with the business system layer and the blockchain network layer respectively; the trusted network layer is used to process data submitted by the business system layer, analyze data flow information, extract node information and relationships and store them into the auxiliary database; the node information includes data flow address, operator, operation mode and time; the relationship is used to describe the direction of data flow; the trusted network layer also constructs a blockchain transaction in combination with the data flow information and uploads it to the blockchain network layer.The present application realizes full life cycle tracking of data resources, can clearly see the source and flow direction of each data resource / product, and supports data fusion product traceability and full process auditing.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of data tracing and verification, and in particular to a blockchain multi-source data auditing and branch tracing system and a data flow tracing method. BACKGROUND

[0002] With the deepening of enterprise digital transformation, business data presents the characteristics of multi-source, complexity and branching. Data from different systems undergoes multiple processing and conversion, and business processes contain multiple conditional branches, making data full-process auditing particularly important and complex. Blockchain technology, with its characteristics of non-tamperability, distributed storage and consensus mechanism, has become an ideal choice for data credible auditing.

[0003] At present, there are various implementation modes of blockchain in the field of data auditing, including full-chain storage, hash storage, hybrid storage and combination with distributed storage system. Full-chain storage records all data on the blockchain, which is suitable for scenarios with small data volume; hash storage only stores data hashes on the chain, and stores complete data in traditional databases, balancing storage efficiency and verification needs; hybrid mode selects different storage methods according to data importance, optimizing resource utilization.

[0004] However, the existing blockchain auditing system mainly adopts a chain structure to record data, which is mainly suitable for the auditing and tracing of linear business processes. This structure faces serious challenges when dealing with complex scenarios of multi-source and multi-branch in actual enterprise applications, which are manifested in the following aspects:

[0005] 1. The existing blockchain data auditing technology has obvious deficiencies in dealing with complex business environments. The linear ledger structure of traditional blockchain is difficult to naturally express the complex relationship network between multi-source data, resulting in unclear data traceability. When a report references multiple data sources, the existing system can only record the hash value of the final report, and cannot effectively associate and verify all original data sources.

[0006] 2. The existing technology can usually only capture the actual execution path when recording business processes, and lacks complete records of conditional branches. In scenarios such as financial approval and medical diagnosis that require strict auditing, it is equally important to understand "why such a decision was made" as well as "what was done", and the existing system lacks such deep auditing capabilities. SUMMARY

[0007] In order to overcome the above-mentioned deficiencies of the prior art in expressing multi-source data relationships and tracking business branches, the present application proposes a blockchain multi-source data auditing and branch tracing system, which analyzes and stores data flow, realizes full life cycle tracking of data resources, can clearly see the source and flow of each data resource / product, and supports data fusion product traceability and full-process auditing.

[0008] The application provides a blockchain multi-source data auditing and branch tracing system, which comprises a business system layer, a trusted network layer and a blockchain network layer.

[0009] The business system layer is used for generating and using data; the trusted network layer is provided with an auxiliary database; the trusted network layer interacts with the business system layer and the blockchain network layer respectively.

[0010] The trusted network layer is used for processing data submitted by the business system layer, analyzing data flow information, extracting node information and relationships and storing them into the auxiliary database; the node information comprises data flow address, operator, operation mode and time; the relationships are used for describing the direction of data flow.

[0011] The trusted network layer further constructs a blockchain transaction in combination with the data flow information and uploads the blockchain transaction to the blockchain network layer.

[0012] Preferably, the trusted network layer comprises an off-chain hierarchical architecture, an off-chain logic module and an interactive interface layer; the interactive interface layer is used for supporting the interaction of the trusted network layer with the business system layer and the blockchain network layer.

[0013] The auxiliary database is arranged in the off-chain hierarchical architecture.

[0014] The off-chain logic module comprises a data center, a verification engine and a transaction construction unit.

[0015] The data center is used for processing data submitted by the business system layer, analyzing data flow information and storing them into the auxiliary database.

[0016] The transaction construction unit is used for constructing a blockchain transaction and storing the blockchain transaction on the chain.

[0017] The verification engine is used for verifying the information in the auxiliary database on the chain in combination with blockchain data.

[0018] Preferably, the data flow information is marked with an importance level; data marked as "important" is stored on the chain; data marked as "less important" is stored on the chain in the form of a hash value.

[0019] Preferably, the auxiliary database comprises two sub-tables; the first sub-table is used for storing node information; and the second sub-table is used for storing relationships.

[0020] Preferably, the blockchain network layer adopts a K-V structure to store data.

[0021] Preferably, the blockchain network layer adopts a distributed ledger technology, and a node network thereof is composed of a plurality of consensus nodes.

[0022] The application provides a blockchain-based data flow transfer tracing method, which first receives a whole-process audit request or a traceability request, determines node information corresponding to a requester in an auxiliary database, performs relationship extraction, identifies a dependency relationship between data before and after the node, and obtains a data tracking path; each node information and the relationship on the path are verified on a chain, a verification report is generated, and the verification report is output.

[0023] Preferably, after receiving the whole-process audit request or the traceability request, node information corresponding to the requester and a tracking depth are parsed, and a longest branch length is the tracking depth.

[0024] The application provides a storage medium storing a computer program, which is executed to implement the blockchain-based data flow transfer tracing method.

[0025] The application has the following advantages:

[0026] (1) The application provides a blockchain multi-source data audit and branch tracing system, which stores data flow transfer information offline through an auxiliary database, realizes tracking of data resources, records a transmission path of data between different participants, forms a complete responsibility chain, facilitates identification of abnormal conditions in data sharing and use, and improves audit efficiency. The application is particularly suitable for complex data ecosystems, can effectively solve problems such as unknown data sources and improper use, and guarantees the security and compliance of data sharing.

[0027] (2) The trusted network layer in the application provides offline storage of data flow transfer information, provides a solid technical foundation for a business system layer, makes multi-source data audit and branch tracing possible, effectively solves the trust problem in traditional data sharing, and provides technical support for safe sharing and effective use of data.

[0028] (3) The application constructs a data relationship graph model based on relationship hash links through relationship extraction between data, and can accurately record and verify blood relationship and dependency relationship between data from different systems and different business processes. The technology ensures the non-tamperability of the data relationship itself through calculation and verification of the relationship hash value, and realizes trusted audit of complex data networks.

[0029] (4) The application significantly improves audit efficiency and reduces costs. The system can automatically construct a data relationship graph, reproduce a business processing path, and verify data, reducing a large amount of manual analysis work. This highly automated audit process not only improves audit accuracy, reduces error and omission rates, but also shortens the audit cycle, provides strong technical support for enterprises to meet increasingly stringent data compliance requirements, makes data management and audit work more efficient and reliable, and has the advantages of high efficiency, high accuracy, high reliability, and the like.

[0030] (5) The application also proposes a data tiered storage strategy, which adopts a hybrid mode of full-chain linking of key data and hash-chain linking of general data according to the importance of data and audit requirements, and designs a complete on-chain and off-chain data consistency verification mechanism. This mechanism significantly improves the storage efficiency and query performance of the system while ensuring data credibility.

[0031] (6) The application realizes a highly credible data audit environment through blockchain technology. The tamper-proof nature of blockchain ensures the authenticity and reliability of audit data, the hash verification mechanism ensures the integrity of data content and transaction process, and the on-chain and off-chain collaborative storage strategy optimizes the utilization of storage resources, balancing security and efficiency, and solving the data credibility problem in traditional audit systems.

[0032] (7) The application can save the mechanism and operation results of decision points by recording the judgment conditions, input parameters and selection basis of each decision point, record the condition branches through relationship storage, and thus build a complete condition branch tree structure, so that complex business processes can be completely restored and verified, fundamentally solving the problem of "knowing what but not why" in traditional audits. The complete record of business process condition branches in the application not only captures "what was done", but also records the decision basis "why it was done", greatly improving the depth and explainability of audits, making it possible to restore and verify complex business processes.

[0033] (8) The data flow tracing method based on blockchain proposed by the application has broken through the audit difficulties of multi-source data and complex business processes. The application supports the recording and verification of complex data relationship networks through the blockchain multi-source data audit and branch tracing system, and displays the complete data blood relationship through the relationship graph model, realizing comprehensive data tracing and full-process audit. When tracing data, the application performs offline tracing through an auxiliary database and then performs on-chain verification, taking into account data tracing efficiency and authenticity verification, and ensuring the reliability of the tracing results.

[0034] (9) The system and method of the application combine to include an automatic audit engine that can automatically build a data relationship graph, reproduce business processing paths, and verify data consistency. This method greatly improves audit efficiency and reduces the workload and error rate of manual audits. BRIEF DESCRIPTION OF DRAWINGS

[0035] Figure 1 A block diagram of a blockchain multi-source data audit and branch tracing system according to the application;

[0036] Figure 2 A business layer structure diagram of a data sharing system;

[0037] Figure 3A multi-branch audit business graph;

[0038] Figure 4 A data storage process flow chart;

[0039] Figure 5 A data traceability process. DETAILED DESCRIPTION

[0040] The technical solutions in the embodiments of the present application will be described clearly and completely below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, rather than all the embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present application.

[0041] As shown in Figure 1 , a blockchain multi-source data audit and branch traceability system includes a business system layer, a trusted network layer, and a blockchain network layer.

[0042] The business system layer is the source of data production and use, and includes multiple independent business systems, such as a data sharing system as shown in Figure 2 . The business system is an application layer for direct user interaction, used to independently generate business data, including structured data and unstructured data.

[0043] In the business system layer, data flows from the provider to the exchange center, and then to the user after necessary processing. The entire process is supervised by the sharing management platform, and the normativity of data sharing is ensured through management and audit functions.

[0044] The business system layer supports multi-dimensional visualization of audited data.

[0045] In specific implementation, the business system layer provides three audit views: data source tracking graph, authorized chain display, and data verification report, for monitoring the complete life cycle of data. This business layer design makes the data sharing process transparent and traceable, and each participant can safely and efficiently exchange and use data under unified rules, providing reliable technical support for cross-organizational data collaboration.

[0046] Business flow can refer to the following Figure 3The data service flow is divided into five service stages horizontally: resource registration, resource release, resource delivery, product release and product delivery; and is divided into five categories vertically according to the participating subjects: data provider A, data provider B, data operator C, data user D and data user E. The data resources (identified by a1, a2, b1, etc.) in the flow flow from left to right, showing the complete life cycle of data from creation to final use. For example, the resources a1 and a2 created by the data provider A are released after registration, and then acquired by the data operator C. The operator processes these resources, creates new products c1 and c2 and releases them, and finally these products are acquired and used by the data users D and E.

[0047] The trusted network layer is the core component of the application, serving as a bridge between the business system and the blockchain, responsible for data management, relationship building and audit query.

[0048] The business system layer interacts with the trusted network layer through a data submission interface and an audit query interface. The trusted network layer interacts with the blockchain network layer through a blockchain interface.

[0049] The trusted network layer includes an off-chain layered architecture, off-chain logic modules and an interaction interface layer. The interaction interface layer is used to support the data submission interface and the audit query interface and the blockchain interface.

[0050] The off-chain layered architecture includes an auxiliary database, which is used to store data flow information, including node information and relationships; the node information includes data flow addresses, operators, operation methods and times; the relationship is used to describe the direction of data flow. Specifically, the auxiliary database includes two sub-tables, sub-table one is used to store node information, and sub-table two is used to store relationships.

[0051] The off-chain layered architecture forms a relationship graph model by extracting and saving the relationship between data, and maintains the blood relationship between multi-source data. The relationship graph model is essentially a topological network model with data flow addresses as nodes and relationships as edges, and the nodes are associated with node information such as data operators, operation times and methods.

[0052] The off-chain logic module includes a data center, a verification engine and a transaction construction unit.

[0053] The data center is used to process the data submitted by the business system layer, parse the data flow information, extract the node information and the relationship and store them in the auxiliary database.

[0054] The transaction construction unit constructs a blockchain transaction in combination with the data flow information obtained by the data center and submits it to the blockchain through the blockchain interface for on-chain storage.

[0055] The verification engine performs data consistency and relationship integrity verification on the information in the auxiliary database, and on-chain verification is performed in combination with the blockchain data.

[0056] Specifically, the data center also labels the importance level of data in combination with data operators and data operation modes during data processing; the transaction construction unit stores all important data on the chain and only stores the hash value of the secondary data on the chain.

[0057] The trusted network layer provides a solid technical foundation for the business system layer, making multi-source data auditing and branch tracing possible, effectively solving the trust problem in traditional data sharing, and providing technical support for secure sharing and effective utilization of data.

[0058] The blockchain network layer is composed of multiple blockchain nodes and provides tamper-proof data storage and verification services, which is the foundation guarantee of data credibility.

[0059] As the security foundation of the entire system, the blockchain network layer adopts a hybrid architecture of "on-chain verification and off-chain storage" to ensure the credibility and traceability of the entire data flow process. This layer design fully considers the balance between the characteristics of blockchain storage and query efficiency, and is particularly suitable for multi-branch audit scenarios.

[0060] The blockchain network layer adopts multiple consensus nodes to form a node network, realizing a distributed consensus blockchain that ensures data consistency through distributed ledger technology. Each consensus node runs a chain service to avoid single point of failure, executes contract operations, and maintains the security and consistency of the blockchain network.

[0061] In this way, the present application combines auxiliary databases and on-chain storage, taking into account performance and security. The auxiliary database stores raw data and related index information and closely cooperates with the logical service to provide efficient data query and storage functions. The blockchain distributed storage stores proof information to ensure the non-tamperability and traceability of data.

[0062] In this system, only the hash information necessary for verification is stored on the chain, reducing storage costs; complex queries are executed in the auxiliary database off-chain to improve query efficiency; and the verification engine periodically checks the consistency of off-chain data and on-chain proof.

[0063] Since each child node in the data relationship graph has and only has one parent node, there is only one route when tracing data sources. However, there may be multiple branches in full-process auditing.

[0064] Referring to Figure 5 The data flow tracing method based on the blockchain proposed by the present application for full-process auditing includes the following steps:

[0065] St1, receive the full-process audit request, determine the node information corresponding to the requester in the auxiliary database as the target node, and construct a tracking path from the data flow conversion information stored in the auxiliary database according to the address of the target node, that is, branch tracking with the target node as the parent node, and find the path.

[0066] St2, verify each node information and relationship on the path on the chain to determine the legality and integrity of data conversion;

[0067] St3, generate a visual verification report of the verification result, and show the verification result of each link, that is, whether the information of each node on the path in the auxiliary database is tampered with, lost, or other abnormal conditions.

[0068] In a specific embodiment, the operation process of the blockchain multi-source data audit and branch tracking system is shown in the following steps S1-S5. Figure 4 、 Figure 5 is a part of the flow diagram.

[0069] S1: system initialization;

[0070] S11, blockchain network initialization;

[0071] S111, deploy a distributed node network, configure the communication protocol and consensus mechanism between nodes;

[0072] S112, deploy an intelligent contract system, including a right confirmation contract, a traceability contract, and a verification contract;

[0073] S113, set the storage engine parameters and configure the K-V structure storage rules;

[0074] S12, trusted network layer initialization;

[0075] S121, establish an auxiliary database table structure, including entities, entity_transformations, flow_definitions, and other tables;

[0076] S122, configure a data hierarchical storage strategy, determine the storage location and method according to the importance of the data;

[0077] S123, initialize the relationship graph model, set the basic attributes of nodes and edges; the node is the address extracted from the node information, and the edge is the relationship.

[0078] S13, interface initialization of the business system layer;

[0079] S131, configure a standardized data submission interface, including data format specifications and identity verification methods;

[0080] S132, set up an audit query interface, define query parameters and result format;

[0081] S133, initialize the audit view display component, configure data visualization parameters.

[0082] S2: data entry chain processing;

[0083] S21, data preprocessing;

[0084] S211, receive the original data submitted by the business system, verify the data integrity and format compliance;

[0085] S212, extract data meta information, including source, timestamp, business type, etc;

[0086] S213, calculate the data hash value as the unique identifier of the data;

[0087] S22, data classification storage;

[0088] S221, determine the storage strategy according to the data importance level, store all key data and hash general data;

[0089] S222, encrypt key data to protect sensitive information;

[0090] S223, store the data and meta information in the auxiliary database, and update the entities table;

[0091] S23, data chain certification;

[0092] S231, build a data certification transaction, including data hash, meta information hash and signature information;

[0093] S232, submit the transaction to the blockchain network and verify the transaction validity through the consensus mechanism;

[0094] S233, after transaction confirmation, get transaction hash and block height, and update the blockchain_nodes table.

[0095] S3: relationship construction and record;

[0096] S31, identify data relationships;

[0097] S311, analyze the reference relationship in business data, identify the dependency and derivation relationship between data;

[0098] S312, generate data conversion description according to data processing logic;

[0099] S313, verify the legality of the relationship to ensure compliance with the predefined business rules;

[0100] S32, record the service branch flow;

[0101] S321, capture the decision points in the service processing, record the judgment conditions and selection basis;

[0102] S322, build a conditional branch tree, mark the execution path and state of each branch;

[0103] S323, store the branch flow description information into the flow_branches table;

[0104] S33, relationship uplink notarization;

[0105] S331, build a relationship transaction, including the source node ID, target node ID and relationship type;

[0106] S332, calculate the relationship hash value, based on the source node, target node and relationship attribute generation;

[0107] S333, submit the relationship transaction to the blockchain, update the entity_transformations table state.

[0108] S4: audit query and verification;

[0109] S41, initialize the audit request;

[0110] S411, receive the user audit query request, verify the user's authority;

[0111] S412, parse the query parameters, determine the audit scope and depth;

[0112] S413, select the appropriate audit strategy according to the query type;

[0113] S42, multi-branch path tracing;

[0114] S421, start from the target node, build the trace path through the entity_transformations table; S422, identify the branch node, restore the complete decision tree;

[0115] S423, extract the business data and processing logic of each node, reconstruct the complete business flow;

[0116] S43, data and relationship verification;

[0117] S431, verify each node on the path on-chain, confirm that the data has not been tampered with;

[0118] S432, verify the legality of the relationship between nodes, ensure compliance with the rules in flow_definitions; S433, check the integrity of the business branch flow, verify the judgment logic of the decision point;

[0119] S44, generate audit report;

[0120] S441, aggregate verification results and mark verification status (pass / fail);

[0121] S442, build visual audit map to show data lineage and business processes;

[0122] S443, generate detailed audit report including data sources, processing history and verification proof.

[0123] S5: exception handling and alarm;

[0124] S51, data anomaly detection;

[0125] S511, detect data hash mismatch and mark potentially tampered data;

[0126] S512, identify unauthorized data access and usage behavior;

[0127] S513, find data relationship anomalies such as missing critical nodes or illegal relationships;

[0128] S52, business rule violation detection;

[0129] S521, check if business processes comply with predefined rules;

[0130] S522, verify the integrity and validity of authorization chain;

[0131] S523, verify if data processing complies with compliance requirements;

[0132] S53, alarm and response;

[0133] S531, generate exception alarm including exception type, severity and impact scope;

[0134] S532, record exception events to audit log for subsequent analysis;

[0135] S533, trigger predefined response process such as notifying relevant responsible person or suspending relevant operation.

[0136] Of course, the present application is not limited to the details of the above-described exemplary embodiments but comprises the same or similar structures which can be realized in other specific forms without departing from the spirit or essential characteristics of the present application. Therefore, the embodiments should be considered in all respects as illustrative and not restrictive, the scope of the present application being defined by the appended claims rather than the above description, and it is intended that all changes which come within the meaning and range of equivalency of the claims are embraced therein. Any reference signs in the claims should not be construed as limiting the claims to the figures in which the reference signs are used.

[0137] Furthermore, it should be understood that although the description is made on the embodiments, not every embodiment contains only one independent technical solution, and the description of the specification is only for the sake of clarity, and the skilled in the art should consider the specification as a whole, and the technical solutions in each embodiment can also be combined appropriately to form other embodiments which can be understood by the skilled in the art.

[0138] The technologies, shapes, and structural parts not described in detail in the present application are well-known technologies.

Claims

1. A blockchain multi-source data auditing and branch tracing system, characterized in that, It includes the business system layer, the trusted network layer, and the blockchain network layer; The business system layer is used to generate and use data; the trusted network layer has an auxiliary database; the trusted network layer interacts with both the business system layer and the blockchain network layer. The trusted network layer is used to process data submitted by the business system layer, parse data flow information, extract node information and relationships, and store them in the auxiliary database. Node information includes data flow address, operator, operation method, and time. Relationships are used to describe the direction of data flow. The trusted network layer also incorporates data flow information to construct blockchain transactions that are uploaded to the blockchain network layer; The trusted network layer comprises an off-chain layered architecture, off-chain logic modules, and an interaction interface layer; the interaction interface layer is used to support the interaction between the trusted network layer, the business system layer, and the blockchain network layer. The off-chain layered architecture includes an auxiliary database, which stores data flow information, including node information and relationships. The auxiliary database contains two sub-tables: sub-table one stores node information, and sub-table two stores relationships. The off-chain layered architecture extracts and saves relationships between data to form a relationship graph model, maintaining the lineage between multi-source data. The relationship graph model is essentially a topological network model with data flow addresses as nodes and relationships as edges, and the nodes are associated with node information. The off-chain logic modules include a data center, a verification engine, and transaction building units; The data center is used to process data submitted by the business system layer, parse data flow information, extract node information and relationships, and store them in the auxiliary database. The transaction construction unit combines the data flow information obtained from the data center to construct a blockchain transaction and submits it to the blockchain through the blockchain interface for on-chain storage; The validation engine performs data consistency and relational integrity verification on the information in the auxiliary database.

2. The blockchain multi-source data auditing and branch tracing system as described in claim 1, characterized in that, Data flow information is marked with importance levels. Data marked as "important" is stored on the blockchain in its entirety; data marked as "secondary important" is stored on the blockchain using its hash value.

3. The blockchain multi-source data auditing and branch tracing system as described in claim 1, characterized in that, The auxiliary database contains two sub-tables: sub-table one stores node information, and sub-table two stores relationships.

4. The blockchain multi-source data auditing and branch tracing system as described in claim 1, characterized in that, The blockchain network layer uses a key-value (KV) structure to store data.

5. The blockchain multi-source data auditing and branch tracing system as described in any one of claims 1-4, characterized in that, The blockchain network layer uses distributed ledger technology, and its node network consists of multiple consensus nodes.

6. A blockchain-based data flow tracing method employing the blockchain multi-source data auditing and branch tracing system as described in any one of claims 1-5, characterized in that, First, receive a full-process audit request or tracing request, determine the node information corresponding to the requester in the auxiliary database, perform relationship extraction, identify the data dependency relationship before and after the node, and obtain the data tracing path; Perform on-chain verification of the information and relationships of each node on the path, generate a verification report, and output it.

7. The data flow traceability method based on blockchain as described in claim 6, characterized in that, After receiving a full-process audit request or a source tracing request, the node information and tracing depth corresponding to the requester are parsed, and the tracing depth is the length of the longest branch traced.

8. A storage medium, characterized in that, The system contains a computer program that, when executed, is used to implement the blockchain-based data flow traceability method as described in claim 6 or 7.

Images