Multi-Cloud Data Shredding and Metadata Distribution
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
As companies increasingly use distributed computing environments like cloud computing to store sensitive data, security risks have risen, particularly when data is stored with a single cloud provider, as unauthorized access can compromise the entire dataset.
Innovation Solution
Data is distributed across different cloud vendors in a multi-cloud environment, where it is encrypted and shredded into chunks, with metadata also encrypted and distributed, using a hash algorithm to select storage locations, thereby multiplying the hurdles for unauthorized access.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If data is stored with a single cloud provider, then data accessibility and simplicity are improved, but security is worsened as unauthorized access can compromise the entire dataset
Solution Approach 1:
The patent divides data into multiple data chunks and distributes them across different cloud service providers. Each chunk is stored separately, so that compromise of one provider does not result in complete data exposure. The segmentation is achieved by splitting the original data file into multiple parts that can be independently stored and managed across different vendors.
Solution Approach 2:
The patent introduces a metadata file as an intermediary that contains information about the location and reconstruction of data chunks. This metadata file is itself shredded and distributed across multiple providers. The intermediary structure allows the system to manage distributed data while maintaining security, as the metadata is also protected through the same distribution mechanism.
2Reliability
If data is shredded into chunks and distributed across multiple cloud vendors, then security is improved by multiplying access hurdles, but device complexity and operational complexity increase
Solution Approach 1:
The patent creates metadata copies that are distributed alongside the data chunks. Each cloud service provider receives both data chunks and corresponding metadata information, allowing them to independently store and manage their portion of the distributed data system. This copying approach simplifies the overall system architecture by eliminating the need for a centralized coordination point.
Solution Approach 2:
The metadata file is itself shredded into multiple metadata chunks and distributed across different cloud providers. This segmentation of metadata mirrors the segmentation of data chunks, creating a parallel structure that simplifies management while maintaining security. Each provider handles only their assigned metadata chunks, reducing the complexity of managing large-scale distributed metadata.
3Quantity of substance
If data is compressed before shredding, then storage efficiency is improved, but the processing time and computational resources required increase
Solution Approach 1:
The patent performs data compression before the shredding operation, preparing the data in advance for optimal storage efficiency. By compressing the data first, the subsequent shredding process operates on already-compressed data, which reduces the overall storage footprint. This preliminary compression action ensures that the data is ready for efficient distribution across multiple cloud providers.
Data Source
AI summary
Systems and methods for enhancing security during access and retrieval of data with multi-cloud storage are disclosed. A method includes: receiving, by a computing device, data to be stored in a distributed computing environment; compressing, by the computing device, the received data; shredding, by the computing device, the compressed data into a plurality of data chunks; storing, by the computing device, the plurality of data chunks in a plurality of locations in the distributed computing environment; generating, by the computing device, a metadata file including a mapping of each of the plurality of data chunks and a corresponding location of the plurality of locations in the distributed computing environment in which the data chunk is stored; shredding, by the computing device, the metadata file into a plurality of file chunks; and storing, by the computing device, the plurality of file chunks in the distributed computing environment.