Data Storage Server Distribution Pattern for Reliable Segmented Backup
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current data storage systems face inefficiencies in memory usage and security concerns when duplicating data across multiple servers, particularly when third-party servers are involved, as they may compromise data integrity and security.
Innovation Solution
A system and method that utilizes error-correcting code schemes to distribute data across multiple servers in a way that minimizes storage requirements, maximizes system reliability, and prevents third-party reverse-engineering, by segmenting data portions across servers so that no single server has the entire data set, allowing for reconstruction by a central distributor.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If data is duplicated in full on each individual backup server, then data availability and reliability are improved, but memory usage becomes intensive and inefficient
Solution Approach 1:
The patent divides the complete data set into multiple segments or portions, distributing different segments across different backup servers. Each server stores only a portion of the total data rather than complete duplicates, significantly reducing the total storage capacity required while maintaining the ability to reconstruct the complete data set through coordinated access to multiple servers.
2Quantity of substance
If portions of data are stored on each individual server to reduce memory use, then memory efficiency is improved, but system reliability and usefulness are reduced
Solution Approach 1:
The patent implements a coordination mechanism where the central system tracks which data segments are stored on which servers, maintaining metadata that maps data portions to server locations. This feedback system enables the reconstruction of complete data sets by querying multiple servers based on the stored segment information, thereby restoring reliability despite distributed storage.
3Quantity of substance
If data is distributed across third-party servers to reduce memory requirements, then storage efficiency is improved, but security risks increase due to potential third-party access
Solution Approach 1:
By segmenting data into multiple portions and distributing them across different third-party servers, the patent ensures that no single server holds the complete data set. This segmentation limits the exposure risk, as compromise of one server does not result in complete data breach, and coordinated access to multiple servers is required to reconstruct the full data.
4Quantity of substance
If error-correcting code schemes are used to transform and store data portions, then memory requirements are reduced, but a method for storing transformed data across servers and creating distribution patterns is needed
Solution Approach 1:
The patent introduces a central coordination system that acts as an intermediary between the error-correcting code transformation process and the distributed storage infrastructure. This intermediary manages the distribution pattern creation, coordinates segment allocation across servers, and handles the reconstruction process, thereby managing the complexity introduced by error-correcting codes without burdening individual storage servers.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
Described are a system, method, and computer program product for generating a data storage server distribution pattern. The method includes determining a set of servers and raw data to be stored. The method also includes transforming the raw data according to an error-correcting code scheme to produce distributable data. The method further includes determining a server reliability of each server in the set of servers. The method further includes generating the data storage server distribution pattern based on maximizing a system reliability relative to maximizing a system entropy. System reliability may be based on a minimum reliability of the set of servers, and system entropy may be based on a cumulated information entropy of each server of the set of servers. The method further includes distributing the distributable data to be stored across at least two servers of the set of servers according to the data storage server distribution pattern.