Private data query method and device, equipment and medium

Abstract

The embodiment of the invention discloses a private data query method and device, equipment and a medium, and the method comprises the steps: constructing an isolated network environment comprising a plurality of network address translation layers, each network address translation layer comprising a plurality of mutually isolated network nodes; deploying a data processing program on each network node; when a preset request initiation center receives a private data query request, the private data query request is sent to a first specific theme; subscribing the data processing program on each network node through a first specific theme, so that each network node receives a private data query request, executes query operation in a local storage based on the private data query request to obtain private data conforming to conditions, and sends the private data conforming to the conditions to a second specific theme; and subscribing to the request initiation center through the second specific theme, so as to receive the privacy data which is sent by each network node and meets the condition through the request initiation center.

Description

Technical Field

[0001] The present invention relates to the field of computer technology, and in particular to a privacy data query method, device, equipment and medium. Background Art

[0002] In the digital age, the generation and storage of data has exploded. As people pay more and more attention to privacy protection, the security of private data has become a key challenge.

[0003] Traditional centralized storage methods may face the following problems when processing large-scale data queries:

[0004] Inefficiency: When a large amount of data needs to be queried, centralized storage requires searching and processing on a central server, which may result in a long query response time and affect the user experience.

[0005] High risk of data leakage: Since all data is stored in one place, once the central server is attacked or the data is leaked, a large amount of privacy data will be at risk. Summary of the invention

[0006] One or more embodiments of this specification provide a privacy data query method, device, equipment and medium for solving the technical problems raised by the background technology.

[0007] One or more embodiments of this specification adopt the following technical solutions:

[0008] One or more embodiments of this specification provide a privacy data query method, the method comprising:

[0009] Construct an isolated network environment including multiple network address translation layers, where each network address translation layer includes multiple isolated network nodes, and each network node performs address translation through network address translation to ensure that direct communication between network nodes is blocked;

[0010] Deploy a data processing program on each network node and store the corresponding private data. The interaction of private data in each network node is carried out through a message queue.

[0011] When the pre-established request initiation center receives the private data query request, the private data query request is sent to the first specific topic;

[0012] Subscribe the data processing program on each network node through the first specific topic, so that each network node receives the private data query request, performs a query operation in the local storage based on the private data query request, obtains private data that meets the conditions, and sends the private data that meets the conditions to the second specific topic;

[0013] The request initiation center is subscribed through the second specific topic, so as to receive the qualified privacy data sent from each network node through the request initiation center.

[0014] It should be noted that the embodiments of this specification have the following beneficial effects through the above contents:

[0015] Improve query efficiency: By distributing and storing private data in an isolated network environment and using message queues for data interaction, query requests can be processed in parallel, improving query efficiency, reducing query response time, and improving user experience.

[0016] Reduce the risk of data leakage: Private data is stored in multiple isolated network nodes instead of being stored in one place, which reduces the risk of data leakage. Even if a network node is attacked, it will only affect the data on that node without affecting the entire system.

[0017] Enhanced data security: Using the network address translation layer to block direct communication between network nodes increases the difficulty for attackers to obtain data. In addition, by subscribing to specific topics for data query, the access scope of data is further limited, thus improving data security.

[0018] Improve system scalability: This method can easily expand the number of network nodes to adapt to the growing amount of data and query requirements. By adding network nodes, the system's processing power and storage capacity can be improved.

[0019] Protecting user privacy: This method ensures that the user's privacy data is protected during the query process. Only qualified data will be sent back to the request initiation center, reducing unnecessary data exposure.

[0020] Improve data availability: Since data is distributed and stored on multiple network nodes, if a node fails, other nodes can still provide data services, improving data availability and reliability.

[0021] Furthermore, if the private data query request is a query for multiple data items, before the pre-established request initiation center receives the private data query request, the method further includes:

[0022] Create a counter in the cache system for each private data query request;

[0023] After each network node receives the private data query request and performs a query operation in a local storage based on the private data query request to obtain private data that meets the conditions, the method further includes:

[0024] The data volume of the qualified privacy data is updated to the corresponding counter in the cache system through each network node.

[0025] It should be noted that the embodiments of this specification have the following beneficial effects through the above contents:

[0026] Improve query efficiency: By creating a counter for each private data query request in the cache system and updating the counter after each network node finds eligible private data, the request initiation center can quickly obtain information about the data volume of the query results. This helps the request initiation center understand the scale of the query results in advance, so as to better plan the subsequent processing flow and improve the overall query efficiency.

[0027] Optimize resource utilization: Based on the data volume information in the counter, the request initiation center can allocate resources more reasonably, such as adjusting the buffer size for receiving data, optimizing the data transmission method, etc., to make full use of system resources and avoid resource waste.

[0028] Provide real-time feedback: The real-time update of the counter can provide users with real-time feedback on the query progress. Users can check the value of the counter to get an approximate number of query results, so as to better understand the progress of the query.

[0029] Furthermore, before the data amount of the qualified privacy data is updated to the corresponding counter in the cache system by each network node, the method further includes:

[0030] Checking, through each network node, whether the value of the counter in the cache system meets a preset total amount of data;

[0031] If the value of the counter in the cache system meets the preset total amount of data, the qualified private data is sent to the second specific topic through each network node.

[0032] It should be noted that the embodiments of this specification have the following beneficial effects through the above contents:

[0033] Total data volume control: By checking whether the value of the counter in the cache system meets the preset total data volume, it can ensure that the amount of private data sent to the second specific topic is within an acceptable range. This helps prevent system performance degradation or other problems caused by excessive data volume.

[0034] Reasonable resource allocation: Based on the total amount of data, each network node can reasonably allocate resources to process and send eligible privacy data. This helps improve the resource utilization efficiency of the system and avoid resource waste.

[0035] Avoid data loss: Ensuring that the total amount of data meets the set value can avoid loss or overwriting problems caused by sending too much data. This helps to ensure the integrity and accuracy of the data.

[0036] Improve system stability: By controlling the amount of data, the system can better cope with high-concurrency query requests, reduce the risk of potential system crashes or failures, and improve system stability.

[0037] Furthermore, if the value of the counter in the cache system does not meet the preset total amount of data, the method further includes:

[0038] The query operation based on the privacy data query request is continued to be performed in the local storage by each network node to obtain the privacy data that meets the conditions.

[0039] Furthermore, after receiving the qualified privacy data sent by each network node through the request initiating center, the method further includes:

[0040] The request initiation center aggregates the privacy data that meets the conditions and is sent by each network node.

[0041] It should be noted that the embodiments of this specification have the following beneficial effects through the above contents:

[0042] Data integration: Aggregate eligible privacy data from each network node to achieve data integration and unified management. This helps reduce data dispersion and improve data consistency and availability.

[0043] Comprehensive analysis: Aggregated privacy data can be analyzed more comprehensively and in depth. By conducting comprehensive analysis of data from multiple network nodes, more complex patterns, trends, and associations can be discovered, providing more valuable information and insights.

[0044] Improve efficiency: Avoid duplication of data analysis on multiple network nodes, improve the efficiency and speed of data analysis. At the same time, it also reduces the time and resource consumption of data processing.

[0045] Enhanced decision support: Aggregated privacy data can provide a more comprehensive and accurate basis for decision making. Decision makers can make more informed decisions based on aggregated data, improving the quality and effectiveness of decisions.

[0046] Furthermore, the aggregating the qualified privacy data sent by each network node through the request initiating center includes:

[0047] The request initiation center deduplicates and sorts the privacy data that meets the conditions and is sent by each network node according to its unique identifier.

[0048] It should be noted that the embodiments of this specification have the following beneficial effects through the above contents:

[0049] Data deduplication: Deduplication through unique identification can remove duplicate private data and ensure that the aggregated data is unique. This helps reduce data redundancy and improve data quality and accuracy.

[0050] Data sorting: Sorting the deduplicated private data can arrange it in a specific order. This helps improve the readability and understandability of the data and facilitates subsequent analysis and processing.

[0051] Improve data consistency: Ensure that the aggregated data is consistent, avoiding errors and confusion caused by duplicate data or inconsistent order.

[0052] Furthermore, the message queue and the cache system are both deployed inside the isolated network environment.

[0053] It should be noted that the embodiments of this specification have the following beneficial effects through the above contents:

[0054] Improve security: Deploying the message queue and cache system in an isolated network environment can effectively prevent attacks and intrusions from external networks and improve system security.

[0055] Protecting privacy: An isolated network environment can protect private data from being accessed by external networks, ensuring the security and confidentiality of data.

[0056] Improve performance: Deploy message queues and cache systems within an isolated network environment to reduce network latency and data transmission time, and improve system performance and response speed.

[0057] Easy to manage: Deploying the message queue and cache system in an isolated network environment can facilitate system management and maintenance, and improve system reliability and stability.

[0058] One or more embodiments of this specification provide a privacy data query device, including:

[0059] An environment construction unit, constructing an isolated network environment including multiple network address translation layers, wherein each network address translation layer includes multiple mutually isolated network nodes, and each network node performs address translation through network address translation to ensure that direct communication between network nodes is blocked;

[0060] A deployment unit deploys a data processing program on each network node and stores the corresponding private data, wherein the interaction of private data in each network node is carried out through a message queue;

[0061] A request receiving unit, when a pre-established request initiating center receives a private data query request, sends the private data query request to a first specific topic;

[0062] a first subscription unit, subscribing a data processing program on each network node through the first specific topic, so that each network node receives the privacy data query request, performs a query operation in a local storage based on the privacy data query request, obtains privacy data that meets the condition, and sends the privacy data that meets the condition to a second specific topic;

[0063] The second subscription unit subscribes the request initiation center through the second specific topic, so as to receive the qualified privacy data sent from each network node through the request initiation center.

[0064] One or more embodiments of this specification provide a privacy data query device, including:

[0065] at least one processor; and,

[0066] a memory communicatively connected to the at least one processor; wherein,

[0067] The memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to:

[0068] Construct an isolated network environment including multiple network address translation layers, where each network address translation layer includes multiple isolated network nodes, and each network node performs address translation through network address translation to ensure that direct communication between network nodes is blocked;

[0069] Deploy a data processing program on each network node and store the corresponding private data. The interaction of private data in each network node is carried out through a message queue.

[0070] When the pre-established request initiation center receives the private data query request, the private data query request is sent to the first specific topic;

[0071] Subscribe the data processing program on each network node through the first specific topic, so that each network node receives the private data query request, performs a query operation in the local storage based on the private data query request, obtains private data that meets the conditions, and sends the private data that meets the conditions to the second specific topic;

[0072] The request initiation center is subscribed through the second specific topic, so as to receive the qualified privacy data sent from each network node through the request initiation center.

[0073] One or more embodiments of this specification provide a non-volatile computer storage medium storing computer executable instructions, which can achieve the following when executed by a computer:

[0074] Construct an isolated network environment including multiple network address translation layers, where each network address translation layer includes multiple isolated network nodes, and each network node performs address translation through network address translation to ensure that direct communication between network nodes is blocked;

[0075] Deploy a data processing program on each network node and store the corresponding private data. The interaction of private data in each network node is carried out through a message queue.

[0076] When the pre-established request initiation center receives the private data query request, the private data query request is sent to the first specific topic;

[0077] Subscribe the data processing program on each network node through the first specific topic, so that each network node receives the private data query request, performs a query operation in the local storage based on the private data query request, obtains private data that meets the conditions, and sends the private data that meets the conditions to the second specific topic;

[0078] The request initiation center is subscribed through the second specific topic, so as to receive the qualified privacy data sent from each network node through the request initiation center.

[0079] At least one of the above technical solutions adopted in the embodiments of this specification can achieve the following beneficial effects:

[0080] Improve query efficiency: By distributing and storing private data in an isolated network environment and using message queues for data interaction, query requests can be processed in parallel, improving query efficiency, reducing query response time, and improving user experience.

[0081] Reduce the risk of data leakage: Private data is stored in multiple isolated network nodes instead of being stored in one place, which reduces the risk of data leakage. Even if a network node is attacked, it will only affect the data on that node without affecting the entire system.

[0082] Enhanced data security: Using the network address translation layer to block direct communication between network nodes increases the difficulty for attackers to obtain data. In addition, by subscribing to specific topics for data query, the access scope of data is further limited, thus improving data security.

[0083] Improve system scalability: This method can easily expand the number of network nodes to adapt to the growing amount of data and query requirements. By adding network nodes, the system's processing power and storage capacity can be improved.

[0084] Protecting user privacy: This method ensures that the user's privacy data is protected during the query process. Only qualified data will be sent back to the request initiation center, reducing unnecessary data exposure.

[0085] Improve data availability: Since data is distributed and stored on multiple network nodes, if a node fails, other nodes can still provide data services, improving data availability and reliability. BRIEF DESCRIPTION OF THE DRAWINGS

[0086] In order to more clearly illustrate the technical solutions in the embodiments of this specification or the prior art, the following briefly introduces the drawings required for use in the embodiments or the prior art description. Obviously, the drawings described below are only some embodiments recorded in this specification. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative labor. In the drawings:

[0087] Figure 1 A flowchart of a privacy data query method provided for one or more embodiments of this specification;

[0088] Figure 2 A request flow diagram provided for one or more embodiments of this specification;

[0089] Figure 3 A schematic diagram of a network structure provided for one or more embodiments of this specification;

[0090] Figure 4 A schematic diagram of the structure of a privacy data query device provided by one or more embodiments of this specification;

[0091] Figure 5 A schematic diagram of the structure of a privacy data query device provided in one or more embodiments of this specification. DETAILED DESCRIPTION

[0092] The embodiments of this specification provide a privacy data query method, device, equipment and medium.

[0093] In order to enable those skilled in the art to better understand the technical solutions in this specification, the technical solutions in the embodiments of this specification will be clearly and completely described below in conjunction with the drawings in the embodiments of this specification. Obviously, the described embodiments are only part of the embodiments of this specification, not all of the embodiments. Based on the embodiments of this specification, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of this specification.

[0094] Figure 1 This is a flowchart of a privacy data query method provided in one or more embodiments of this specification, and the flowchart can be executed by a privacy data query system. Certain input parameters or intermediate results in the flowchart allow manual intervention and adjustment to help improve accuracy.

[0095] The method steps of the embodiment of this specification are as follows:

[0096] S102, constructing an isolated network environment including multiple network address translation layers, wherein each network address translation layer includes multiple mutually isolated network nodes, and each network node performs address translation through network address translation to ensure that direct communication between network nodes is blocked.

[0097] In the examples of this specification, the above content can be implemented by the following specific implementation scheme:

[0098] Design network architecture: Determine the hierarchical structure of the isolated network environment, including the number of network address translation layers and the number of network nodes under each layer. Plan the network topology to ensure the connection and communication paths between each network node.

[0099] Configure Network Address Translation (NAT): In each network address translation layer, set up a NAT device or function. Configure NAT rules to translate the internal address of each network node into an externally accessible address. Ensure that NAT rules prevent direct communication between network nodes and only allow communication after address translation through NAT.

[0100] Network node settings: Assign a unique internal address to each network node. Configure the network settings of the network node, including IP address, subnet mask, gateway, etc. Ensure that the firewall or security policy of the network node blocks direct communication with other network nodes.

[0101] Isolation mechanism: Use physical isolation or logical isolation to ensure that network nodes between different network address translation layers are isolated from each other. Technologies such as VLAN, subnet division, and firewall rules can be used to achieve isolation.

[0102] Communication control: Define the allowed communication rules and policies, such as which network nodes can communicate with the external network, and the direction and type of communication. Configure access control lists (ACLs) or other security mechanisms to restrict communication between network nodes.

[0103] Monitoring and management: Establish a monitoring system to monitor the communication activities, status and performance of network nodes in real time. Configure management tools to manage and make configuration changes to the network address translation layer, network nodes and isolation mechanisms.

[0104] S104, deploying a data processing program on each network node and storing the corresponding private data, wherein the interaction of private data in each network node is performed through a message queue.

[0105] In the examples of this specification, the above content can be implemented by the following specific implementation scheme:

[0106] Design data processing programs: Determine the requirements and functions of data processing, such as data cleaning, transformation, analysis, etc. Select appropriate programming languages ​​and frameworks to develop data processing programs.

[0107] Deploy the data processing program: Install the data processing program on each network node. Configure the program's operating environment, including required dependencies and configuration files.

[0108] Configure message queues: Select a suitable message queue system, such as RabbitMQ. Install and configure the message queue client on each network node. Create a message queue and assign corresponding queue permissions to each network node.

[0109] Data storage: Determine how private data is stored, such as in a database, file system, etc. Set up data storage on each network node and ensure data security and confidentiality.

[0110] Data interaction process: When a network node needs to exchange private data with other nodes, it sends the data to the corresponding message queue. Other network nodes receive the data from the message queue and perform corresponding data processing. After the processing is completed, the result data is sent back to the message queue of the sending node, or sent to other specified nodes.

[0111] Error handling and monitoring: Establish an error handling mechanism to handle errors that may occur during data interaction. Monitor the status of the message queue and the operation of the data processing program to discover and solve problems in a timely manner.

[0112] S106: When the pre-established request initiation center receives the private data query request, the private data query request is sent to the first specific topic.

[0113] S108, subscribing the data processing program on each network node through the first specific topic, so that each network node receives the privacy data query request, performs a query operation in the local storage based on the privacy data query request, obtains the privacy data that meets the conditions, and sends the privacy data that meets the conditions to the second specific topic.

[0114] S110, subscribing the request initiation center through the second specific topic, so as to receive the qualified privacy data sent from each network node through the request initiation center.

[0115] In the examples of this specification, the above content can be implemented by the following specific implementation scheme:

[0116] Establish a request initiation center: Create a central server or service as the request initiation center. Configure the connection between the request initiation center and the RocketMQ message queue system.

[0117] Set specific topics**: Create two specific topics in RocketMQ: QueryRequests and QueryResponses. Use the QueryRequests topic to send private data query requests, and use the QueryResponses topic to receive qualified private data responses.

[0118] Network node configuration: Deploy a data handler on each network node. Configure the data handler to subscribe to the QueryRequests topic to receive private data query requests. After receiving a query request, the data handler performs a query operation in the local storage and sends the private data that meets the conditions to the QueryResponses topic.

[0119] Request initiation center operation: When the request initiation center receives a private data query request, it sends the request to the QueryRequests topic. The request initiation center subscribes to the QueryResponses topic to receive qualified private data responses from each network node.

[0120] Data processing and response: After receiving the query request in the QueryRequests topic, the data processing program on each network node performs a local query operation. The data processing program sends the qualified privacy data to the QueryResponses topic. The request initiation center receives the qualified privacy data sent by each network node from the QueryResponses topic.

[0121] Error handling and monitoring: Establish an error handling mechanism to handle errors that may occur during the query process. Monitor the operating status of the request initiation center and each network node, as well as the flow and performance of the message queue.

[0122] Furthermore, if the privacy data query request is a query for multiple data, a counter may be created in the cache system for each privacy data query request before the pre-established request initiation center receives the privacy data query request. Each network node receives the privacy data query request, performs a query operation in the local storage based on the privacy data query request, and after obtaining the privacy data that meets the conditions, the data volume of the privacy data that meets the conditions may be updated to the corresponding counter in the cache system through each network node.

[0123] It should be noted that the embodiments of this specification have the following beneficial effects through the above contents:

[0124] Improve query efficiency: By creating a counter for each private data query request in the cache system and updating the counter after each network node finds eligible private data, the request initiation center can quickly obtain information about the data volume of the query results. This helps the request initiation center understand the scale of the query results in advance, so as to better plan the subsequent processing flow and improve the overall query efficiency.

[0125] Optimize resource utilization: Based on the data volume information in the counter, the request initiation center can allocate resources more reasonably, such as adjusting the buffer size for receiving data, optimizing the data transmission method, etc., to make full use of system resources and avoid resource waste.

[0126] Provide real-time feedback: The real-time update of the counter can provide users with real-time feedback on the query progress. Users can check the value of the counter to get an approximate number of query results, so as to better understand the progress of the query.

[0127] Furthermore, before updating the data amount of the qualified privacy data to the corresponding counter in the cache system through each network node, each network node can check whether the value of the counter in the cache system meets the pre-set total data amount; if the value of the counter in the cache system meets the pre-set total data amount, the qualified privacy data will be sent to the second specific topic through each network node.

[0128] It should be noted that the embodiments of this specification have the following beneficial effects through the above contents:

[0129] Total data volume control: By checking whether the value of the counter in the cache system meets the preset total data volume, it can ensure that the amount of private data sent to the second specific topic is within an acceptable range. This helps prevent system performance degradation or other problems caused by excessive data volume.

[0130] Reasonable resource allocation: Based on the total amount of data, each network node can reasonably allocate resources to process and send eligible privacy data. This helps improve the resource utilization efficiency of the system and avoid resource waste.

[0131] Avoid data loss: Ensuring that the total amount of data meets the set value can avoid loss or overwriting problems caused by sending too much data. This helps to ensure the integrity and accuracy of the data.

[0132] Improve system stability: By controlling the amount of data, the system can better cope with high-concurrency query requests, reduce the risk of potential system crashes or failures, and improve system stability.

[0133] Furthermore, if the value of the counter in the cache system does not meet the preset total amount of data, each network node may continue to execute the query operation in the local storage based on the privacy data query request to obtain privacy data that meets the conditions.

[0134] Furthermore, after receiving the qualified privacy data sent from each network node through the request initiation center, the qualified privacy data sent by each network node can be aggregated through the request initiation center.

[0135] In the examples of this specification, the above content can be implemented by the following specific implementation scheme:

[0136] Data aggregation logic: Design aggregation logic to determine how to aggregate private data from different network nodes. You can choose the appropriate aggregation method based on specific needs, such as sum, average, count, etc.

[0137] Aggregation operation: After receiving a sufficient amount of private data, the request initiating center performs aggregation calculations on the data according to the aggregation logic. The aggregation operation can be implemented using programming languages ​​or data processing tools.

[0138] It should be noted that the embodiments of this specification have the following beneficial effects through the above contents:

[0139] Data integration: Aggregate eligible privacy data from each network node to achieve data integration and unified management. This helps reduce data dispersion and improve data consistency and availability.

[0140] Comprehensive analysis: Aggregated privacy data can be analyzed more comprehensively and in depth. By conducting comprehensive analysis of data from multiple network nodes, more complex patterns, trends, and associations can be discovered, providing more valuable information and insights.

[0141] Improve efficiency: Avoid duplication of data analysis on multiple network nodes, improve the efficiency and speed of data analysis. At the same time, it also reduces the time and resource consumption of data processing.

[0142] Enhanced decision support: Aggregated privacy data can provide a more comprehensive and accurate basis for decision making. Decision makers can make more informed decisions based on aggregated data, improving the quality and effectiveness of decisions.

[0143] Furthermore, when the request initiation center aggregates the qualified privacy data sent by each network node, the request initiation center can deduplicate and sort the qualified privacy data sent by each network node according to the unique identifier.

[0144] In the examples of this specification, the above content can be implemented by the following specific implementation scheme:

[0145] Extract unique identifier: For each received private data, extract its unique identifier. The unique identifier can be a field in the data or an identifier generated by some algorithm.

[0146] Deduplication: Use appropriate data structures or algorithms to perform deduplication on stored private data. You can determine whether the data is duplicated based on the unique identifier and remove the duplicate data.

[0147] Sorting operation: Sort the deduplicated private data according to the unique identifier. Common sorting algorithms can be used, such as bubble sort, quick sort, etc.

[0148] Aggregation results: After deduplication and sorting, the aggregated privacy data results are obtained.

[0149] It should be noted that the embodiments of this specification have the following beneficial effects through the above contents:

[0150] Data deduplication: Deduplication through unique identification can remove duplicate private data and ensure that the aggregated data is unique. This helps reduce data redundancy and improve data quality and accuracy.

[0151] Data sorting: Sorting the deduplicated private data can arrange it in a specific order. This helps improve the readability and understandability of the data and facilitates subsequent analysis and processing.

[0152] Improve data consistency: Ensure that the aggregated data is consistent, avoiding errors and confusion caused by duplicate data or inconsistent order.

[0153] Furthermore, the message queue and the cache system are both deployed inside the isolated network environment.

[0154] It should be noted that the embodiments of this specification have the following beneficial effects through the above contents:

[0155] Improve security: Deploying the message queue and cache system in an isolated network environment can effectively prevent attacks and intrusions from external networks and improve system security.

[0156] Protecting privacy: An isolated network environment can protect private data from being accessed by external networks, ensuring the security and confidentiality of data.

[0157] Improve performance: Deploy message queues and cache systems within an isolated network environment to reduce network latency and data transmission time, and improve system performance and response speed.

[0158] Easy to manage: Deploying the message queue and cache system in an isolated network environment can facilitate system management and maintenance, and improve system reliability and stability.

[0159] It should be noted that with the advent of the digital age, the protection of private data has become one of the key challenges. Traditional centralized storage methods are not only inefficient when facing large-scale data queries, but also have a high risk of data leakage. The embodiments of this specification propose an innovative solution that aims to protect private data security and improve query efficiency through a secure isolation network environment and an efficient data query mechanism.

[0160] The purpose of the embodiments of this specification is to provide a privacy data query method based on the protection of a secure isolated network environment, aiming to solve the problems existing in the current privacy data query process, such as high risk of data leakage, low query efficiency and difficulty in supporting large-scale concurrent queries.

[0161] Specifically, the embodiments of this specification are intended to achieve their purpose in the following ways:

[0162] 1. Enhanced data security protection: By building a complex network environment with multiple layers of NAT (network address translation) and deploying isolated network nodes in this environment, it is ensured that each node only stores part of the private data, thereby greatly reducing the risk of large-scale data leakage. In addition, direct communication between nodes is blocked, further enhancing data security.

[0163] 2. Improve query efficiency and flexibility: Use message queues (such as RocketMQ) as the transmission medium for query requests and responses to achieve asynchronous distribution of query requests and rapid aggregation of response data. This method not only reduces network latency, but also allows each node to process query requests in parallel, significantly improving query efficiency. At the same time, by introducing caching technologies such as Redis, the embodiments of this specification can flexibly control the query process of multiple data, support users to set the data volume of query results as needed, and further improve the flexibility of the query.

[0164] For specific implementation of the embodiments of this specification, see Figure 2 The request flow diagram shown is as follows:

[0165] 1. Securely isolate the network environment

[0166] Multi-layer NAT network design: Build a network environment with multiple NAT (Network Address Translation) layers, each of which contains multiple isolated network nodes. These nodes perform address translation through NAT to ensure that direct communication between nodes is blocked, thereby achieving physical or logical isolation.

[0167] Node deployment and data storage: Deploy data processing programs on each isolated network node and store some private data. Nodes do not communicate directly with each other, and all data interactions are done through message queues (such as RocketMQ, Figure 2 mq) in order to ensure the security and integrity of the data.

[0168] 2. Query Request and Response Mechanism

[0169] Query request issued:

[0170] Establish a central node (i.e., request initiation center) to receive users' privacy data query requests.

[0171] The central node encapsulates the query request information and sends it to a specific topic of RocketMQ (such as "QueryRequests"). This topic is designed for programs on each network node to subscribe to in order to receive query requests.

[0172] Node query processing:

[0173] The program on each network node subscribes to the "QueryRequests" topic and once a query request is received, the query operation is performed based on the locally stored data.

[0174] During the query process, the node uses local resources to process the data to ensure the efficiency and accuracy of the query.

[0175] Response data sent:

[0176] After finding the data that meets the conditions, the node encapsulates the result data (with a unique identifier) ​​into a message and sends it to another topic of RocketMQ (such as "QueryResponses"). This topic is designed for the central node to subscribe to in order to receive query results from each node.

[0177] 3. Multiple data query control

[0178] Redis counter introduction:

[0179] When multiple pieces of data need to be queried, the central node first creates a counter for each query request in Redis before initiating the query request.

[0180] After each node has queried the corresponding data, it updates the queried data amount to the corresponding counter in Redis.

[0181] Determine and send the total amount of data:

[0182] Each time a node sends data, it checks the counter value in Redis to determine whether the total amount of data specified by the user has been reached.

[0183] Once the total amount of data is reached, the node immediately sends the accumulated data in batches to the "QueryResponses" topic. If the total amount of data is not reached, the query continues and the counter value is updated. If the threshold is exceeded, no more data is sent to ensure that there is no excessive data leakage.

[0184] 4. Data Aggregation and Response

[0185] Central node data aggregation:

[0186] The central node subscribes to the "QueryResponses" topic to collect and aggregate query results from each node.

[0187] During the aggregation process, the central node deduplicates and sorts the query results based on the unique identifier to ensure that the query results returned to the user are accurate and orderly.

[0188] Query Response:

[0189] The central node returns the aggregated data to the user to complete the query response. During the response process, the central node can also encrypt or desensitize the data as needed to further protect user privacy.

[0190] The embodiments of this specification have the following beneficial effects:

[0191] Enhanced data security: Multi-layer NAT and node isolation effectively prevent data leakage and illegal access, and improve the protection level of privacy data.

[0192] Improve query efficiency: Use RocketMQ for asynchronous messaging to reduce network latency and request processing time, while distributed storage improves data processing capabilities.

[0193] Flexible control of the query process: The introduction of Redis counters makes the management of multiple query requests more convenient, and users can flexibly set the data volume of the query results according to their needs.

[0194] Easy to expand and maintain: The method of the embodiment of this specification is based on a modular design, which is easy to expand and modify according to actual needs, thereby reducing the maintenance cost of the system.

[0195] Figure 3 A schematic diagram of a network structure provided for one or more embodiments of this specification, wherein a web and a server (request initiation center / central node) are interconnected, and a server and each network node in a node area are interconnected, and each network node includes node 1, node 2, ...

[0196] Figure 4 A structural diagram of a privacy data query device provided for one or more embodiments of this specification includes: an environment construction unit 402, a deployment unit 404, a request receiving unit 406, a first subscription unit 408 and a second subscription unit 410.

[0197] The environment construction unit 402 constructs an isolated network environment including multiple network address translation layers, wherein each network address translation layer includes multiple mutually isolated network nodes, and each network node performs address translation through network address translation to ensure that direct communication between network nodes is blocked;

[0198] A deployment unit 404 deploys a data processing program on each network node and stores corresponding private data, wherein the interaction of private data in each network node is performed through a message queue;

[0199] The request receiving unit 406 sends the private data query request to the first specific topic when the pre-established request initiating center receives the private data query request;

[0200] A first subscription unit 408 subscribes a data processing program on each network node through the first specific topic, so that each network node receives the privacy data query request, performs a query operation in a local storage based on the privacy data query request, obtains privacy data that meets the conditions, and sends the privacy data that meets the conditions to a second specific topic;

[0201] The second subscription unit 410 subscribes the request initiation center through the second specific topic, so as to receive the qualified privacy data sent from each network node through the request initiation center.

[0202] Figure 5 A schematic diagram of a privacy data query device provided for one or more embodiments of this specification includes:

[0203] at least one processor; and,

[0204] a memory communicatively connected to the at least one processor; wherein,

[0205] The memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to:

[0206] Construct an isolated network environment including multiple network address translation layers, where each network address translation layer includes multiple isolated network nodes, and each network node performs address translation through network address translation to ensure that direct communication between network nodes is blocked;

[0207] Deploy a data processing program on each network node and store the corresponding private data. The interaction of private data in each network node is carried out through a message queue.

[0208] When the pre-established request initiation center receives the private data query request, the private data query request is sent to the first specific topic;

[0209] Subscribe the data processing program on each network node through the first specific topic, so that each network node receives the private data query request, performs a query operation in the local storage based on the private data query request, obtains private data that meets the conditions, and sends the private data that meets the conditions to the second specific topic;

[0210] The request initiation center is subscribed through the second specific topic, so as to receive the qualified privacy data sent from each network node through the request initiation center.

[0211] One or more embodiments of this specification provide a non-volatile computer storage medium storing computer executable instructions, which can achieve the following when executed by a computer:

[0212] Construct an isolated network environment including multiple network address translation layers, where each network address translation layer includes multiple isolated network nodes, and each network node performs address translation through network address translation to ensure that direct communication between network nodes is blocked;

[0213] Deploy a data processing program on each network node and store the corresponding private data. The interaction of private data in each network node is carried out through a message queue.

[0214] When the pre-established request initiation center receives the private data query request, the private data query request is sent to the first specific topic;

[0215] Subscribe the data processing program on each network node through the first specific topic, so that each network node receives the private data query request, performs a query operation in the local storage based on the private data query request, obtains private data that meets the conditions, and sends the private data that meets the conditions to the second specific topic;

[0216] The request initiation center is subscribed through the second specific topic, so as to receive the qualified privacy data sent from each network node through the request initiation center.

[0217] Each embodiment in this specification is described in a progressive manner, and the same or similar parts between the embodiments can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the device, equipment, and non-volatile computer storage medium embodiments, since they are basically similar to the method embodiments, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

Claims

1. A privacy data query method, characterized in that: include: Construct an isolated network environment including multiple network address translation layers, where each network address translation layer includes multiple isolated network nodes, and each network node performs address translation through network address translation to ensure that direct communication between network nodes is blocked; Deploy a data processing program on each network node and store the corresponding private data. The interaction of private data in each network node is carried out through a message queue. When the pre-established request initiation center receives the private data query request, the private data query request is sent to the first specific topic; Subscribe the data processing program on each network node through the first specific topic, so that each network node receives the private data query request, performs a query operation in the local storage based on the private data query request, obtains private data that meets the conditions, and sends the private data that meets the conditions to the second specific topic; The request initiation center is subscribed through the second specific topic so as to receive qualified privacy data sent from each network node through the request initiation center.

2. The method according to claim 1, characterized in that: If the private data query request is a query for multiple data items, before the pre-established request initiation center receives the private data query request, the method further includes: Create a counter in the cache system for each private data query request; After each network node receives the private data query request and performs a query operation in a local storage based on the private data query request to obtain private data that meets the conditions, the method further includes: The data volume of the qualified privacy data is updated to the corresponding counter in the cache system through each network node.

3. The method according to claim 2, characterized in that Before the data amount of the qualified privacy data is updated to the corresponding counter in the cache system by each network node, the method further includes: Checking, through each network node, whether the value of the counter in the cache system meets a preset total amount of data; If the value of the counter in the cache system meets the preset total amount of data, the qualified private data is sent to the second specific topic through each network node.

4. The method according to claim 3, characterized in that If the value of the counter in the cache system does not meet the preset total amount of data, the method further includes: The query operation based on the privacy data query request is continued to be performed in the local storage by each network node to obtain the privacy data that meets the conditions.

5. The method according to claim 1, characterized in that After the request initiating center receives the qualified privacy data sent from each network node, the method further includes: The request initiation center aggregates the privacy data that meets the conditions and is sent by each network node.

6. The method according to claim 1, characterized in that The request initiation center aggregates the qualified privacy data sent by each network node, including: The request initiation center deduplicates and sorts the qualified privacy data sent by each network node according to its unique identifier.

7. The method according to claim 2, characterized in that The message queue and the cache system are both deployed inside the isolated network environment.

8. A privacy data query device, characterized in that: include: An environment construction unit, constructing an isolated network environment including multiple network address translation layers, wherein each network address translation layer includes multiple mutually isolated network nodes, and each network node performs address translation through network address translation to ensure that direct communication between network nodes is blocked; A deployment unit deploys a data processing program on each network node and stores the corresponding private data, wherein the interaction of private data in each network node is carried out through a message queue; A request receiving unit, when a pre-established request initiating center receives a private data query request, sends the private data query request to a first specific topic; a first subscription unit, subscribing a data processing program on each network node through the first specific topic, so that each network node receives the privacy data query request, performs a query operation in a local storage based on the privacy data query request, obtains privacy data that meets the condition, and sends the privacy data that meets the condition to a second specific topic; The second subscription unit subscribes the request initiation center through the second specific topic, so as to receive the qualified privacy data sent from each network node through the request initiation center.

9. A privacy data query device, characterized in that: include: at least one processor; as well as, a memory communicatively connected to the at least one processor; wherein, The memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to: Construct an isolated network environment including multiple network address translation layers, where each network address translation layer includes multiple isolated network nodes, and each network node performs address translation through network address translation to ensure that direct communication between network nodes is blocked; Deploy a data processing program on each network node and store the corresponding private data. The interaction of private data in each network node is carried out through a message queue. When the pre-established request initiation center receives the private data query request, the private data query request is sent to the first specific topic; Subscribe the data processing program on each network node through the first specific topic, so that each network node receives the private data query request, performs a query operation in the local storage based on the private data query request, obtains private data that meets the conditions, and sends the private data that meets the conditions to the second specific topic; The request initiation center is subscribed through the second specific topic so as to receive qualified privacy data sent from each network node through the request initiation center.

10. A non-volatile computer storage medium, characterized in that: Computer executable instructions are stored, and when the computer executable instructions are executed by a computer, the following can be achieved: Construct an isolated network environment including multiple network address translation layers, where each network address translation layer includes multiple isolated network nodes, and each network node performs address translation through network address translation to ensure that direct communication between network nodes is blocked; Deploy a data processing program on each network node and store the corresponding private data. The interaction of private data in each network node is carried out through a message queue. When the pre-established request initiation center receives the private data query request, the private data query request is sent to the first specific topic; Subscribe the data processing program on each network node through the first specific topic, so that each network node receives the private data query request, performs a query operation in the local storage based on the private data query request, obtains private data that meets the conditions, and sends the private data that meets the conditions to the second specific topic; The request initiation center is subscribed through the second specific topic so as to receive qualified privacy data sent from each network node through the request initiation center.

Images