Distributed Data Encryption via Parallel Node Processing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing technologies face challenges in efficiently encrypting and decrypting large data sets across multiple node devices in a distributed environment, particularly in storing and retrieving encrypted data blocks while maintaining data integrity and security.
Innovation Solution
An apparatus and method that involve a processor component to transmit encryption commands to node devices, receive metadata, and generate map entries for encrypted data blocks, using salt values and passphrases to encrypt and decrypt data blocks in parallel, with a control device coordinating storage and retrieval of encrypted data blocks.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If large data sets are encrypted and stored across multiple node devices in a distributed environment, then data security and integrity are improved, but the complexity of coordinating encryption and decryption operations among multiple devices increases
Solution Approach 1:
The patent segments the data set into multiple data blocks, with each block encrypted independently using unique encryption data. This segmentation allows parallel processing across multiple node devices while maintaining security, as each device handles only its assigned portion without needing to coordinate with others for the encryption operation itself.
Solution Approach 2:
The control device generates encryption data for each data block in advance, before the actual encryption operation. This preliminary generation of encryption keys and data allows node devices to independently encrypt their assigned blocks without real-time coordination, reducing the complexity of inter-device communication during the encryption process.
2Reliability
If encryption data is generated and stored for each data block, then data security is improved, but the storage space required and the time to manage encryption data increases
Solution Approach 1:
The patent implements a hierarchical storage structure where encryption data is nested within the data file itself. The control device stores encryption data in a structured format that includes pointers to data blocks and their corresponding encryption data, creating a self-contained system where the encryption metadata is integrated into the overall data file structure rather than requiring separate storage systems.
3Productivity
If multiple node devices encrypt data blocks in parallel, then encryption speed and productivity are improved, but synchronization and coordination overhead between devices increases
Solution Approach 1:
Each node device independently performs encryption of its assigned data blocks using pre-generated encryption data from the control device. The devices operate autonomously without needing to synchronize with each other during the encryption process, as each device has all the necessary encryption credentials locally. This self-service approach eliminates inter-device synchronization overhead while maintaining parallel processing efficiency.
4Speed
If map data structures are used to track encrypted data blocks, then data retrieval efficiency is improved, but the complexity of generating and managing map entries increases
Solution Approach 1:
The map data structure serves multiple functions simultaneously: it tracks the location of encrypted data blocks, stores pointers to encryption data, and provides a hierarchical organization system for large data sets. This multi-functional design consolidates what would otherwise require separate systems into a single unified structure, reducing overall system complexity while maintaining efficient retrieval capabilities.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
An apparatus includes a processor component of a first node device caused to receive data block encryption data and an indication of size of an encrypted data block distributed to the first node device for decryption, and in response to the data set being of encryptd data: receive an indication of the quantity of sub-blocks within the encrypted data block, and a hashed identifier for each data sub-block; use the data block encryption data to decrypt the encrypted data block to regenerate data set portions from the data sub-blocks; analyze the hashed identifier of each data sub-block to determine whether all data set portions are distributed to the first node device for processing; and in response to a determination that at least one data set portion is to be distributed to a second node device for processing, transmit the at least one data set portion to the second node device.