A federated data sharing method and device based on front-end nodes
By introducing a federated data sharing method based on pre-nodes in the data sharing system, data privacy and security issues are solved, data security, efficient sharing and reliability are achieved, and system transparency and data traceability are improved.
Patent Information
- Application Number
- CN202411845229.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-12-16
- Publication Date
- 2025-02-28
- Estimated Expiration
- 2044-12-16
AI Technical Summary
The existing data sharing system has data privacy and security problems, and the centralized model has single point of failure, poor scalability, low data transmission efficiency, and the risks of data leakage and abuse.
The federated data sharing method based on the pre-node is adopted to encrypt and pre-process the federated data through the pre-node and upload it to the private chain to ensure the security and privacy of the data during transmission. Other nodes feedback verification values based on the actual situation in the region or correct federal data. Regulators regularly conduct performance supervision and data statistical analysis on nodes on the entire chain.
It realizes the secure and efficient sharing of federal data, ensures the privacy and reliability of data, improves the accuracy and consistency of data, and enhances the transparency of the system and the traceability of data.
Smart Images

Figure FT_1
Abstract
Description
Technical Field
[0001] The present invention relates to the field of data sharing, and in particular to a method and device for sharing federated data based on a front-end node. Background Art
[0002] With the rapid development of information technology, data collection, processing and sharing are becoming increasingly important. Especially driven by the Internet of Things, cloud computing and big data technologies, real-time data collection and analysis are crucial to improving decision-making efficiency and service quality. However, with the diversification of data sources and the complexity of data types, traditional data sharing and processing methods face many challenges.
[0003] In existing data sharing systems, data usually comes from different devices and platforms, including sensors, mobile devices, enterprise systems, etc. These data have significant differences in type, format and source, which are called "multi-source heterogeneous data". The integration and sharing of multi-source heterogeneous data is a complex process because it involves multiple steps such as data standardization, cleaning, conversion and loading; in addition, data privacy and security are also issues that need to be focused on in the data sharing process; existing data sharing technologies often adopt a centralized model, where data is stored on the server, and the central server is responsible for data distribution and processing. This model has some inherent problems, such as single point failure, poor scalability, and low data transmission efficiency; in addition, centralized data storage also increases the risk of data leakage and abuse.
[0004] To solve these problems, researchers have proposed a variety of decentralized data sharing methods, such as federated learning and blockchain technology; federated learning allows multiple participants to jointly train models without sharing original data, protecting the privacy of the data; blockchain technology provides a decentralized data storage and verification platform, ensuring the immutability and transparency of the data. Under the federated learning or federated computing framework, the data collection held by multiple autonomous nodes (such as different databases, organizations or entities) is usually referred to as "federated data."
[0005] Although these technologies have solved the problem of data sharing to a certain extent, they still face challenges when processing data; for example, how to achieve real-time sharing of data while protecting data privacy, and how to ensure the security and reliability of data throughout the sharing process.
[0006] In view of the above problems, the present invention provides a front-end node-based federated data sharing method and device, aiming to achieve secure and efficient sharing of federated data and ensure the privacy and reliability of data throughout the sharing process. Summary of the invention
[0007] In order to overcome the above-mentioned defects of the prior art, an embodiment of the present invention provides a method and device for sharing federated data based on a front-end node to solve the problems raised in the above-mentioned background technology.
[0008] A method for sharing federated data based on a front-end node, characterized in that it includes the following steps: S1, the front-end node encrypts the acquired federated data and uploads it to a private chain; S2, the front-end node uploads the basic public service information of the region to the private chain; S3, the front-end node calculates the characteristics of the federated data and requests verification on the chain; S4, other nodes feedback the verification value or correct the federated data according to the actual situation in the region; S5, the regulatory agency regularly performs performance supervision and data statistical analysis on the nodes on the entire chain.
[0009] Furthermore, each node in S1-S5 includes an on-chain data sharing node, an off-chain data sharing node and an off-chain non-shared node. The off-chain data sharing node and the off-chain non-shared node are both communicatively connected to the on-chain data sharing node, and a pre-node is set between the off-chain data sharing node and the off-chain non-shared node and the on-chain data sharing node.
[0010] Furthermore, the off-chain data sharing node is communicatively connected with the on-chain data sharing node through the front-end node, and the information transmission steps between the off-chain data sharing node and the on-chain data sharing node are as follows: the off-chain data sharing node sends a data sharing command to the front-end node, the front-end node obtains the private chain address through the on-chain data sharing node, and transmits the private chain address to the off-chain data sharing node, and the off-chain data sharing node sends verification information to the private chain address; verifies whether it is legal and correct through the communication layer, and receives the verification information fed back by the data sharing layer, the off-chain data sharing node sends federal data to the front-end node, and the front-end node uploads the federal data sent by the off-chain data sharing node to the private chain.
[0011] Furthermore, the off-chain non-shared node is communicated with the on-chain data sharing node through the front node, and the information transmission steps between the off-chain non-shared node and the on-chain data sharing node are as follows: the off-chain non-shared node directly sends verification information to the private chain address, and the off-chain non-shared node waits to receive verification information fed back by the on-chain data sharing node; the off-chain non-shared node sends a query data request to the front node; the front node forwards the query data request to the private chain; the front node receives the query data request feedback data from the private chain, and transmits it back to the off-chain non-shared node.
[0012] Furthermore, the private chain includes a data layer, a communication layer, a sharing layer and a supervision layer. The communication layer includes a shared node library and a verification block. The sharing layer includes a data sharing layer and a data query layer. The supervision layer includes a data statistics calculation layer and a performance calculation layer.
[0013] Furthermore, the step of S1 uploading the federated data to the private chain is as follows: the off-chain data sharing node sends a data sharing command to the front-end node, the front-end node obtains the private chain address through the on-chain data sharing node, and transmits the private chain address to the off-chain data sharing node, the off-chain data sharing node sends verification information to the private chain address, verifies whether it is legal and correct through the communication layer, and receives the verification information fed back by the data sharing layer, the off-chain data sharing node sends the federated data to the front-end node, the front-end node uploads the federated data to the private chain and connects with the communication layer and the sharing layer, the off-chain data sharing node waits to receive the verification information fed back by the on-chain data sharing node, verifies whether it is legal and correct through the data sharing layer, and receives the verification information returned by the data sharing layer, the off-chain data sharing node encrypts the data uploaded in the private chain, and the off-chain data sharing node sends the federated data to the private chain to complete the upload of the federated data.
[0014] Furthermore, the specific steps of uploading the basic service information of the local area to the private chain in S2 are: the off-chain data sharing node establishes a communication connection with the private chain through the front-end node, and the off-chain data sharing node directly uploads the basic service information to the supervision layer of the private chain for calculation; the basic service information includes unit information, population information, environmental information, transportation facility construction and municipal engineering construction information.
[0015] Furthermore, the specific steps in S3 are as follows: the off-chain data sharing node inputs the federated data features into the sharing layer; the sharing layer matches the federated data with the target label, performs labeling processing according to the target label, and feeds back the information to the off-chain data sharing node; the off-chain data sharing node waits to receive the verification information fed back by the on-chain data sharing node; the off-chain data sharing node compares and verifies the federated data in the supervision layer and the sharing layer, uploads the comparison verification information to the private chain, and verifies the comparison verification information in the supervision layer: the off-chain data sharing node encrypts the data uploaded in the private chain; the off-chain data sharing node sends the federated data to the private chain to complete the upload of the federated data.
[0016] Furthermore, the S4 other nodes feed back verification values or correct the federated data according to the actual situation in the region. The specific steps are as follows: the other nodes receive the verification values and determine whether there are differences. If there are differences, the federated data are corrected according to the actual situation in the region; the other nodes compare and analyze the corrected federated data with the federated data in the private chain until a unified feedback value is obtained, and the shared nodes off the chain synchronize the federated data.
[0017] The present application also proposes a federated data sharing device based on a front-end node, comprising:
[0018] Module M1: Encrypt the obtained federated data through the front-end node and upload it to the private chain;
[0019] Module M2: Upload the basic public service information of the region to the private chain through the front-end node;
[0020] Module M3: Calculate the federated data features through the front-end node and request verification on the chain;
[0021] Module M4: Other nodes feedback verification values or modify federal data based on the actual situation in their region;
[0022] Module M5: Regulators regularly conduct performance supervision and data statistical analysis on nodes across the entire chain.
[0023] The present invention provides a front-end node-based federated data sharing method and device, which ensures the security and privacy of data during transmission by performing data preprocessing and encryption on the front-end node. The off-chain data sharing node can verify and share data with the on-chain node without leaking the original data, thereby protecting the privacy of the data. The verification and correction mechanism of multiple nodes improves the accuracy and consistency of the data and ensures the reliability of the data. All data upload, verification and correction processes are recorded on the private chain, thereby improving the transparency of the system and the traceability of the data. The technical solution supports the upload and sharing of federated data and can be flexibly processed according to different data types and business requirements. The front-end node acts as an intermediary , can optimize the data transmission process, improve processing efficiency, and reduce the load on the nodes on the chain. The existence of the supervision layer allows regulators to regularly monitor the performance of nodes on the entire chain to ensure the accuracy and timeliness of data sharing. Through comparison analysis and correction mechanisms, the system can tolerate and correct errors in the data transmission process, improve the stability and reliability of the system, allow nodes in different regions to correct and feedback data according to the actual situation in the region, promote cross-regional data collaboration, provide a safe and reliable data sharing platform, and promote data sharing and collaboration between different organizations and departments. The technical solution is suitable for a variety of application scenarios, such as smart cities, financial services, healthcare, etc., and has good adaptability and practicality. BRIEF DESCRIPTION OF THE DRAWINGS
[0024] Figure 1 The present invention is a flowchart of a federated data sharing method based on a front-end node according to an embodiment of the present application.
[0025] The realization of the purpose, functional features and advantages of the present invention will be further explained in conjunction with embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION
[0026] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.
[0027] Those skilled in the art will understand that, unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as those generally understood by those skilled in the art in the field to which the present invention belongs. It should also be understood that terms such as those defined in common dictionaries should be understood to have meanings consistent with the meanings in the context of the prior art, and will not be interpreted with idealized or overly formal meanings unless specifically defined as here.
[0028] Reference Figure 1In order to achieve the above-mentioned invention object, the present invention provides a federated data sharing method based on a front-end node, comprising the following steps:
[0029] S1. The front-end node encrypts the obtained federated data and uploads it to the private chain;
[0030] S2, the front-end node uploads the basic public service information of the region to the private chain;
[0031] S3. The front-end node calculates the federated data features and uploads them to the chain for verification;
[0032] S4. Other nodes feedback verification values or modify federated data based on the actual situation in their region;
[0033] S5. Regulatory agencies regularly conduct performance supervision and data statistical analysis on nodes across the entire chain.
[0034] In this embodiment, the front-end node uploads the acquired federal data to the private chain. The data is encrypted and uploaded to a private blockchain. The front-end node is also responsible for uploading the basic public service information of the local area. This information is also encrypted and uploaded to the private chain so that it can be analyzed and shared together with other data. By uploading the data to the private chain, the security and privacy of the data are ensured to prevent the data from being accessed or tampered with without authorization. The front-end node pre-processes the uploaded federal data to extract key features. The extracted features are encapsulated into a data packet and attached with a chain request, which is sent to other nodes on the private chain for verification. Other nodes verify the data features provided by the front-end node according to the actual situation in the local area. If deviations or errors are found in the data, the node will feedback the verification. The value can be directly corrected or the data can be directly corrected, and the corrected data can be uploaded to the private chain again; data sharing and collaboration between different nodes enable various regions to make better use of data and improve the quality and efficiency of public services. The verification and correction mechanism of multiple nodes improves the accuracy and reliability of data. Regulators regularly supervise the performance of nodes on the entire chain to ensure the accuracy and timeliness of data sharing. At the same time, regulators will also conduct statistical analysis of data on the chain to identify trends, predict future events and optimize public services. Regular supervision and data analysis by regulators help to identify problems in a timely manner and optimize them, thereby improving the operating efficiency of the entire system. At the same time, the immutability of blockchain technology increases the transparency of the system and enhances the public's trust in project services.
[0035] In one embodiment, each node in S1-S5 includes an on-chain data sharing node, an off-chain data sharing node and an off-chain non-shared node. The off-chain data sharing node and the off-chain non-shared node are both communicatively connected to the on-chain data sharing node, and a pre-node is set between the off-chain data sharing node and the off-chain non-shared node and the on-chain data sharing node.
[0036] In this embodiment, each node plays different roles through the division of labor among on-chain data sharing nodes, off-chain data sharing nodes and off-chain non-sharing nodes. On-chain data sharing nodes are responsible for storing and sharing data on the blockchain, and use the immutability and transparency of the blockchain to ensure the security and traceability of data. Off-chain data sharing nodes are responsible for processing and storing data that does not need to be on the chain. They communicate with on-chain nodes and upload necessary data to on-chain nodes. A pre-node is set between the off-chain data sharing nodes and the on-chain data sharing nodes. The pre-node serves as a bridge between the off-chain data sharing nodes and the on-chain data sharing nodes, and is responsible for data pre-processing, encryption and uploading to ensure the security of data during transmission.
[0037] In one embodiment, the off-chain data sharing node is communicated with the on-chain data sharing node through the front-end node, and the information transmission steps between the off-chain data sharing node and the on-chain data sharing node are as follows: the off-chain data sharing node sends a data sharing command to the front-end node, the front-end node obtains the private chain address through the on-chain data sharing node, and transmits the private chain address to the off-chain data sharing node, the off-chain data sharing node sends verification information to the private chain address; verifies whether it is legal and correct through the communication layer, and receives the verification information fed back by the data sharing layer, the off-chain data sharing node sends federal data to the front-end node, and the front-end node uploads the federal data sent by the off-chain data sharing node to the private chain.
[0038] In this embodiment, the off-chain data sharing node sends a data sharing command to the front-end node to start the data sharing process. The off-chain data sharing node actively requests the front-end node to start the data sharing process. The front-end node obtains the private chain address through the on-chain data sharing node. The front-end node confirms which blockchain address the data should be uploaded to. This is the basis of communication and data transmission. The front-end node transmits the private chain address to the off-chain data sharing node, providing the off-chain data sharing node with an exact upload destination to ensure that the data can be sent to the correct blockchain location. Incorrect address information will cause data transmission failure. The off-chain data sharing node sends verification information to the private chain address. Before data sharing, verification information is sent first to ensure the legitimacy and accuracy of the data. Accuracy: Verify whether it is legal and correct through the communication layer to prevent illegal or malicious data from being uploaded to the blockchain. At the same time, receive verification information fed back by the data sharing layer to ensure the transparency and traceability of the data sharing process. The off-chain data sharing node sends the federal data to the front-end node, and transmits the data from the source to the front-end node to prepare for uploading to the blockchain. The front-end node uploads the federal data sent by the off-chain data sharing node to the private chain, and permanently stores the data on the blockchain to ensure that the data cannot be tampered with and is durable. The front-end node pre-processes and verifies the data, which increases the security of data transmission. Through standardized communication processes, the complexity of data sharing is reduced, and the consistency and accuracy of the data are ensured through the on-chain verification mechanism.
[0039] In one embodiment, the off-chain non-shared node is communicated with the on-chain data sharing node through the front node, and the information transmission steps between the off-chain non-shared node and the on-chain data sharing node are as follows: the off-chain non-shared node directly sends verification information to the private chain address, and the off-chain non-shared node waits to receive verification information fed back by the on-chain data sharing node; the off-chain non-shared node sends a query data request to the front node; the front node forwards the query data request to the private chain; the front node receives the query data request feedback data from the private chain, and transmits it back to the off-chain non-shared node.
[0040] In this embodiment, the off-chain non-shared node directly sends verification information to the private chain address. The off-chain non-shared node directly interacts with the blockchain network and sends verification information to prove the legitimacy of its identity or data. Verification is a prerequisite for ensuring network security and data accuracy. The off-chain non-shared node waits to receive the verification information fed back by the on-chain data sharing node to ensure that the off-chain non-shared node can receive the feedback from the on-chain node to confirm whether its verification request is accepted. The off-chain non-shared node sends a query data request to the front node. When the off-chain non-shared node needs to query the on-chain data, it sends a request through the front node to To reduce the load on the nodes on the chain, the front-end node forwards the query data request to the private chain. As an intermediary, the front-end node forwards the query request to the private chain to ensure that the request can be processed correctly. The front-end node receives the query data request feedback data from the private chain and transmits it back to the non-shared node off the chain to complete the data query process. Security policies such as authentication and authorization can be implemented through the front-end node to ensure that only legitimate nodes can access the blockchain, cache data, reduce the load on the nodes on the chain, and improve the response speed. At the same time, it is easier to add or remove non-shared nodes off the chain without directly modifying the configuration of the nodes on the chain.
[0041] In one embodiment, the private chain includes a data layer, a communication layer, a sharing layer and a supervision layer. The communication layer includes a shared node library and a verification block. The sharing layer includes a data sharing layer and a data query layer. The supervision layer includes a data statistics calculation layer and a performance calculation layer.
[0042] In this embodiment, the internal division of labor of the private chain is specifically refined and clarified. The data layer is responsible for the storage and recording of data and is the foundation of the entire private chain. The blockchain itself is a distributed database and is very suitable for use as a data layer. The communication layer includes a shared node library and a verification block to ensure the uniformity of information transmission and data format between nodes. The verification block ensures the legitimacy of transactions and is one of the basic functions of the blockchain network. Communication between nodes is achieved through a P2P network. The sharing layer includes a data sharing layer and a data query layer. The data sharing layer is responsible for data distribution and sharing. The data query layer provides data retrieval services. The distributed nature of the blockchain allows data to be shared between nodes. At the same time, indexing and database technology can be used to achieve efficient data query. The supervision layer includes a data statistics calculation layer and a performance calculation layer. The data statistics calculation layer is responsible for analyzing and counting on-chain data. The performance calculation layer monitors network performance and node performance. Data statistics and performance monitoring can be achieved through smart contracts and off-chain services.
[0043] In one embodiment, the step of S1 uploading federated data to the private chain is as follows: the off-chain data sharing node sends a data sharing command to the front-end node, the front-end node obtains the private chain address through the on-chain data sharing node, and transmits the private chain address to the off-chain data sharing node, the off-chain data sharing node sends verification information to the private chain address, verifies whether it is legal and correct through the communication layer, and receives the verification information fed back by the data sharing layer, the off-chain data sharing node sends the federated data to the front-end node, the front-end node uploads the federated data to the private chain and connects with the communication layer and the sharing layer, the off-chain data sharing node waits to receive the verification information fed back by the on-chain data sharing node, verifies whether it is legal and correct through the data sharing layer, and receives the verification information returned by the data sharing layer, the off-chain data sharing node encrypts the data uploaded in the private chain, and the off-chain data sharing node sends the federated data to the private chain to complete the upload of the federated data.
[0044] In this embodiment, the off-chain data sharing node sends a data sharing command to the front-end node to start the data sharing process. The off-chain data sharing node actively requests the front-end node to start the data sharing process. The front-end node obtains the private chain address through the on-chain data sharing node. The front-end node confirms which blockchain address the data should be uploaded to. This is the basis of communication and data transmission. The front-end node transmits the private chain address to the off-chain data sharing node, providing the off-chain data sharing node with an exact upload destination to ensure that the data can be sent to the correct blockchain location. Incorrect address information will cause data transmission failure. The off-chain data sharing node sends verification information to the private chain address. Before data sharing, verification information is sent first to ensure the legitimacy and accuracy of the data. The communication layer verifies whether it is legal and correct to prevent illegal or malicious data from being uploaded to the blockchain. At the same time, the verification information fed back by the data sharing layer is received to ensure Transparency and traceability of the data sharing process. The off-chain data sharing node sends the federated data to the front-end node, transferring the data from the source to the front-end node in preparation for uploading to the blockchain. The front-end node uploads the federated data sent by the off-chain data sharing node to the private chain, and permanently stores the data on the blockchain to ensure the immutability and durability of the data. The front-end node pre-processes and verifies the data, which increases the security of data transmission. The off-chain data sharing node encrypts the data uploaded in the private chain. The off-chain data sharing node sends the federated data to the private chain to complete the upload of the federated data. Multiple verification steps are used to ensure the security of the data and the legitimacy of the transaction, which enhances the overall security of the system. The multi-step confirmation and verification mechanism improves the reliability of data transmission and ensures that the data is accurately uploaded to the blockchain. At the same time, data encryption provides an additional layer of privacy protection for sensitive information.
[0045] In one embodiment, the specific steps of uploading the basic service information of the local area to the private chain in S2 are: the off-chain data sharing node establishes a communication connection with the private chain through the front-end node, and the off-chain data sharing node directly uploads the basic service information to the supervision layer of the private chain for calculation; the basic service information includes unit information, population information, environmental information, transportation facility construction and municipal engineering construction information.
[0046] In this embodiment, the off-chain data sharing node establishes a communication connection with the private chain through the front-end node: ensuring that the data can be transmitted to the blockchain network safely and reliably, the off-chain data sharing node directly uploads the basic service information to the supervision layer of the private chain for calculation: realizing transparent management and real-time monitoring of data, improving the efficiency and accuracy of data processing, and the uploaded basic service information includes unit information, population information, environmental information, transportation facility construction and municipal engineering construction information, providing comprehensive data support for the regulatory layer, and helping to achieve more refined and intelligent management.
[0047] In one embodiment, the specific steps in S3 are as follows: the off-chain data sharing node inputs the federated data features into the sharing layer; the sharing layer matches the federated data with the target tag, performs labeling processing according to the target tag, and feeds back the information to the off-chain data sharing node; the off-chain data sharing node waits to receive the verification information fed back by the on-chain data sharing node; the off-chain data sharing node compares and verifies the federated data in the supervision layer and the sharing layer, uploads the comparison verification information to the private chain, and verifies the comparison verification information in the supervision layer: the off-chain data sharing node encrypts the data uploaded in the private chain; the off-chain data sharing node sends the federated data to the private chain to complete the upload of the federated data.
[0048] In this embodiment, the off-chain data sharing node inputs the federated data features into the sharing layer: this step allows the features of the data to be identified and utilized, providing a basis for subsequent data matching and processing. The sharing layer matches the federated data with the target tag: by matching the target tag, the data can be classified and organized to facilitate subsequent query and use. The tagging process is performed according to the target tag: the tagging process helps index and retrieve the data and improves the efficiency of data management. The information is fed back to the off-chain data sharing node: it ensures that the off-chain node can receive feedback from the on-chain node to form a closed loop of data sharing. The off-chain data sharing node waits for the verification information fed back by the on-chain data sharing node: this step ensures the data The accuracy and legitimacy of the data are verified. The off-chain data sharing node compares and verifies the federal data in the supervision layer and the sharing layer: comparison and verification help ensure the consistency and correctness of the data, and uploads the comparison and verification information to the private chain: uploading verification information increases the transparency and traceability of the data, and verifies the comparison and verification information in the supervision layer: the final verification ensures the legitimacy and accuracy of the data. The off-chain data sharing node encrypts the data uploaded in the private chain: encryption improves the security of the data, and the off-chain data sharing node sends the federal data to the private chain to complete the upload of the federal data: completing the final upload of the data to ensure that the data is officially recorded on the blockchain.
[0049] In one embodiment, the S4 other nodes feed back verification values or correct federal data according to the actual situation in the local area. The specific steps are as follows: the other nodes receive the verification value and determine whether there is a difference. If there is a difference, the federal data is corrected according to the actual situation in the local area; the other nodes compare and analyze the corrected federal data with the federal data in the private chain until a unified feedback value is obtained, and the shared nodes off the chain synchronize the federal data.
[0050] In this embodiment, other nodes receive the verification value: this step ensures the consistency and correctness of the data, provides a benchmark for subsequent data processing, and determines whether there are differences: by comparing the verification values, it can be found whether there are problems with the data, which helps to improve the accuracy of the data, and makes corrections based on the actual situation in the region: allowing nodes to make corrections based on local data to ensure the regional adaptability and accuracy of the data, and comparative analysis: through comparative analysis, the consistency of the data can be further verified and the reliability of the data can be improved. Unified feedback value: ensure that all nodes have a unified understanding of the data, and enhance the data consistency of the entire network. The off-chain shared nodes synchronize the data: the final synchronization ensures that the data of all nodes is up to date, and improves the real-time and response speed of the entire system.
[0051] The present invention also provides a federated data sharing device based on a front-end node, comprising:
[0052] Module M1: Encrypt the obtained federated data through the front-end node and upload it to the private chain;
[0053] Module M2: Upload the basic public service information of the region to the private chain through the front-end node;
[0054] Module M3: Calculate the federated data features through the front-end node and request verification on the chain;
[0055] Module M4: Other nodes feedback verification values or modify federal data based on the actual situation in their region;
[0056] Module M5: Regulators regularly conduct performance supervision and data statistical analysis on nodes across the entire chain.
[0057] The operation mode of the device in this embodiment refers to the aforementioned method embodiment, which will not be described in detail here.
[0058] Those of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, storage, database or other media provided in this application and used in the embodiments may include non-volatile and / or volatile memory. Non-volatile memory may include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM) or flash memory. Volatile memory may include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (SSRSDRAM), enhanced SDRAM (ESDRAM), synchronous link (Synchlink) DRAM (SLDRAM), memory bus (RambuS) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM), etc.
[0059] In summary, the present invention provides a method and device for sharing federated data based on front-end nodes. By preprocessing and encrypting data on the front-end nodes, the security and privacy of data during transmission are ensured. The off-chain data sharing nodes can verify and share data with on-chain nodes without leaking the original data, thereby protecting the privacy of the data. The verification and correction mechanism of multiple nodes improves the accuracy and consistency of the data and ensures the reliability of the data. All data upload, verification and correction processes are recorded on the private chain, thereby improving the transparency of the system and the traceability of the data. The technical solution supports the upload and sharing of federated data and can be flexibly processed according to different data types and business requirements. The front-end nodes can be used as As an intermediary, it can optimize the data transmission process, improve processing efficiency, and reduce the load on the nodes on the chain. The existence of the supervision layer allows regulators to regularly monitor the performance of nodes on the entire chain to ensure the accuracy and timeliness of data sharing. Through comparison analysis and correction mechanisms, the system can tolerate and correct errors in the data transmission process, improve the stability and reliability of the system, allow nodes in different regions to correct and feedback data according to the actual situation in the region, promote cross-regional data collaboration, provide a safe and reliable data sharing platform, and promote data sharing and collaboration between different organizations and departments. The technical solution is suitable for a variety of application scenarios, such as smart cities, financial services, healthcare, etc., and has good adaptability and practicality.
Claims
1. A federated data sharing method based on a front-end node, characterized in that: The following steps are included: S1. The front-end node encrypts the obtained federated data and uploads it to the private chain; S2, the front-end node uploads the basic public service information of the region to the private chain; S3. The front-end node calculates the federated data features and uploads them to the chain for verification; S4. Other nodes feedback verification values or modify federated data based on the actual situation in their region; S5. Regulatory agencies regularly conduct performance supervision and data statistical analysis on nodes on the entire chain; Each node in S1-S5 includes an on-chain data sharing node, an off-chain data sharing node and an off-chain non-shared node. The off-chain data sharing node and the off-chain non-shared node are both connected to the on-chain data sharing node in communication, and a pre-node is set between the off-chain data sharing node and the off-chain non-shared node and the on-chain data sharing node; The private chain includes a data layer, a communication layer, a sharing layer and a supervision layer. The communication layer includes a shared node library and a verification block. The sharing layer includes a data sharing layer and a data query layer. The supervision layer includes a data statistics calculation layer and a performance calculation layer. The step of S1 uploading the federated data to the private chain is as follows: the off-chain data sharing node sends a data sharing command to the front-end node, the front-end node obtains the private chain address through the on-chain data sharing node, and transmits the private chain address to the off-chain data sharing node, the off-chain data sharing node sends verification information to the private chain address, verifies whether it is legal and correct through the communication layer, and receives the verification information fed back by the data sharing layer, the off-chain data sharing node sends the federated data to the front-end node, the front-end node uploads the federated data to the private chain and connects with the communication layer and the sharing layer, the off-chain data sharing node waits to receive the verification information fed back by the on-chain data sharing node, verifies whether it is legal and correct through the data sharing layer, and receives the verification information returned by the data sharing layer, the off-chain data sharing node encrypts the data uploaded in the private chain, and the off-chain data sharing node sends the federated data to the private chain to complete the upload of the federated data; The basic public service information includes unit information, population information, environmental information, transportation facility construction and municipal engineering construction information.
2. The method for sharing federated data based on a front-end node according to claim 1, characterized in that: The off-chain data sharing node is communicated with the on-chain data sharing node through the front-end node. The information transmission steps between the off-chain data sharing node and the on-chain data sharing node are as follows: the off-chain data sharing node sends a data sharing command to the front-end node, the front-end node obtains the private chain address through the on-chain data sharing node, and transmits the private chain address to the off-chain data sharing node, and the off-chain data sharing node sends verification information to the private chain address; verifies whether it is legal and correct through the communication layer, and receives the verification information fed back by the data sharing layer. The off-chain data sharing node sends federal data to the front-end node, and the front-end node uploads the federal data sent by the off-chain data sharing node to the private chain.
3. The method for sharing federated data based on a front-end node according to claim 1, characterized in that: The off-chain non-shared node communicates with the on-chain data sharing node through the front node, and the information transmission steps between the off-chain non-shared node and the on-chain data sharing node are as follows: the off-chain non-shared node directly sends verification information to the private chain address, and the off-chain non-shared node waits to receive verification information fed back by the on-chain data sharing node; the off-chain non-shared node sends a query data request to the front node; the front node forwards the query data request to the private chain; the front node receives the query data request feedback data from the private chain, and transmits it back to the off-chain non-shared node.
4. The method for sharing federated data based on a front-end node according to claim 1, characterized in that: The specific steps of uploading the basic public service information of the local area to the private chain in S2 are as follows: the off-chain data sharing node establishes a communication connection with the private chain through the front-end node, and the off-chain data sharing node directly uploads the basic public service information to the supervision layer of the private chain for calculation.
5. The method for sharing federated data based on a front-end node according to claim 4, characterized in that: The specific steps in S3 are as follows: the off-chain data sharing node inputs the federated data features into the sharing layer; the sharing layer matches the federated data with the target label, performs labeling processing according to the target label, and feeds back the information to the off-chain data sharing node; the off-chain data sharing node waits to receive the verification information fed back by the on-chain data sharing node; the off-chain data sharing node compares and verifies the federated data in the supervision layer and the sharing layer, uploads the comparison verification information to the private chain, and verifies the comparison verification information in the supervision layer: the off-chain data sharing node encrypts the data uploaded in the private chain; the off-chain data sharing node sends the federated data to the private chain to complete the upload of the federated data.
6. The method for sharing federated data based on a front-end node according to claim 5, characterized in that: The S4 other nodes feed back verification values or correct the federated data according to the actual situation in the region. The specific steps are as follows: the other nodes receive the verification values and determine whether there are differences. If there are differences, the federated data are corrected according to the actual situation in the region. Other nodes compare and analyze the revised federal data with the federal data in the private chain until a unified feedback value is obtained, and the off-chain shared nodes synchronize the federal data.
7. A federated data sharing device based on a front-end node, characterized in that: include: Module M1: Encrypt the obtained federated data through the front-end node and upload it to the private chain; Module M2: Upload the basic public service information of the region to the private chain through the front-end node; Module M3: Calculate the federated data features through the front-end node and request verification on the chain; Module M4: Other nodes feedback verification values or modify federal data based on the actual situation in their region; Module M5: The regulatory agency regularly conducts performance supervision and data statistical analysis on the nodes on the entire chain; Each node in M1-M5 includes an on-chain data sharing node, an off-chain data sharing node and an off-chain non-shared node. The off-chain data sharing node and the off-chain non-shared node are both communicatively connected with the on-chain data sharing node, and a pre-node is set between the off-chain data sharing node and the off-chain non-shared node and the on-chain data sharing node; The private chain includes a data layer, a communication layer, a sharing layer and a supervision layer. The communication layer includes a shared node library and a verification block. The sharing layer includes a data sharing layer and a data query layer. The supervision layer includes a data statistics calculation layer and a performance calculation layer. The steps of M1 uploading the federated data to the private chain are as follows: the off-chain data sharing node sends a data sharing command to the front-end node, the front-end node obtains the private chain address through the on-chain data sharing node, and transmits the private chain address to the off-chain data sharing node, the off-chain data sharing node sends verification information to the private chain address, verifies whether it is legal and correct through the communication layer, and receives the verification information fed back by the data sharing layer, the off-chain data sharing node sends the federated data to the front-end node, the front-end node uploads the federated data to the private chain and connects with the communication layer and the sharing layer, the off-chain data sharing node waits to receive the verification information fed back by the on-chain data sharing node, verifies whether it is legal and correct through the data sharing layer, and receives the verification information returned by the data sharing layer, the off-chain data sharing node encrypts the data uploaded in the private chain, and the off-chain data sharing node sends the federated data to the private chain to complete the upload of the federated data; The basic public service information includes unit information, population information, environmental information, transportation facility construction and municipal engineering construction information.
Citation Information
Patent Citations
Medical data security sharing method based on block chain and federated learning
CN111698322A
Data security sharing method, system and device
CN111901309A