Dispersed Storage Encoding for Secure Failure-Tolerant Data Storage
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current distributed storage and task processing systems face challenges in ensuring secure, reliable, and efficient data storage and processing across multiple geographically dispersed locations, particularly in handling large datasets and complex tasks, while maintaining data integrity and security.
Innovation Solution
A distributed computing system that employs dispersed error encoding and decoding techniques to segment and distribute data across multiple storage units, allowing for secure, reliable, and efficient storage and processing of data, with error correction mechanisms to ensure data integrity and tolerance to failures, and secure task execution across geographically dispersed units.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If data is distributed across multiple geographically dispersed storage units, then data availability and reliability are improved, but data security and integrity become more difficult to ensure
Solution Approach 1:
The patent segments data into multiple slices and distributes them across different storage units. Each slice is encrypted with unique keys, so that no single storage unit holds the complete unencrypted data. This segmentation approach maintains data availability across distributed units while enhancing security through encryption and key distribution mechanisms.
Solution Approach 2:
The patent introduces authentication and authorization modules as intermediaries between access requests and stored data. These modules verify credentials, check permissions, and manage key distribution, acting as a security layer that protects distributed data without compromising availability. The intermediary ensures that only authorized users can access specific data slices.
2Reliability
If redundant copies of data are stored for failure tolerance, then reliability is improved, but storage efficiency and cost increase
Solution Approach 1:
The patent uses error correction codes to create redundant information in the form of parity slices rather than simple data copies. These parity slices enable reconstruction of original data even when some storage units fail, providing failure tolerance with more efficient use of storage capacity compared to traditional redundant copying methods.
Solution Approach 2:
The patent changes the parameter of data representation by applying encryption and error correction coding. Instead of storing raw data copies, the system transforms data into encrypted slices with embedded redundancy, allowing the same storage capacity to provide both security and failure tolerance functions simultaneously.
3Object-affected harmful factors
If complex security protocols are implemented for distributed data access, then data security is improved, but access speed and operational efficiency decrease
Solution Approach 1:
The patent implements preliminary authentication and authorization actions before data access. User credentials are verified and permissions are checked in advance, and appropriate encryption keys are distributed beforehand. This preliminary security processing prevents security checks from blocking data access paths during actual retrieval operations, maintaining both security and access speed.
Solution Approach 2:
The patent implements self-service mechanisms where authenticated users receive their own decryption keys and can independently access their authorized data without requiring real-time intervention from central authentication authorities. This self-service approach maintains security through cryptographic protection while eliminating bottlenecks that would slow down data access.
Data Source
AI summary
A method to securely store a data file in a dispersed storage network (DSN) in a manner to increase difficulty in hacking the data file begins by a dispersed storage (DS) processing module encoding the data file into a plurality of data portions. The method continues with the DS processing module dispersed storage error encoding a first data portion to produce a set of encoded data slices, generating a set of DSN addresses, and sending the set of encoded data slices to a first set of storage units using the set of DSN addresses. The method continues with the DS processing module dispersed storage error encoding a second data portion to produce a second set of encoded data slices, generating a second set of DSN addresses, and sending the second set of encoded data slices to a second set of storage units using the second set of DSN addresses.


