Distributed Data Storage Redundancy Optimization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing backup systems often result in unnecessary duplication of data across devices, leading to inefficiencies and security concerns due to the lack of optimized data distribution and redundancy mechanisms.
Innovation Solution
A system and method for distributed shared data storage that optimizes data distribution by using redundancy levels based on data value, employing access control and encryption, and utilizing mechanisms to hide identifying information, ensuring no single device contains all necessary information to recreate the original data, with features like pointer-based data sharing and variable-sized stripes for efficient storage.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If data is distributed to multiple devices for backup, then data redundancy and security are improved, but data duplication and storage space consumption increase
Solution Approach 1:
The patent divides data into multiple segments or strips, where each segment is stored on a different device. This segmentation allows the data to be distributed across multiple devices for redundancy while avoiding complete duplication of the entire dataset on each device. The data can be reconstructed from a sufficient number of segments, achieving reliability without excessive duplication.
Solution Approach 2:
The patent implements variable redundancy levels where different data segments can have different redundancy requirements based on their value or importance. Critical data segments can be distributed to more devices with higher redundancy, while less critical segments can have lower redundancy. This local quality approach optimizes storage space by applying different duplication strategies to different parts of the data.
2Reliability
If complete copies of data are stored on multiple devices, then data recovery capability is improved, but storage efficiency and memory conservation deteriorate
Solution Approach 1:
Instead of storing complete copies of data on all devices, the patent stores only partial segments of data on each device. The system calculates and stores only the necessary portions of data required to achieve the desired redundancy level, avoiding excessive duplication. This partial action approach maintains data recovery capability while significantly improving storage efficiency.
3Reliability
If data is encrypted and identifying information is hidden, then security is improved, but system complexity and processing overhead increase
Solution Approach 1:
The patent extracts and separates identifying information from the main data segments. By removing metadata and identifiers that could compromise security, the system reduces the risk of unauthorized access while simplifying the encryption process. Only essential data segments are encrypted and distributed, reducing overall system complexity compared to encrypting complete data copies with full metadata on each device.
Data Source
AI summary
Embodiments relate to a computer-based method of checking a network to determine whether a certain number of copies of data are backed up onto the peer devices of the network. If the certain number of copies of the data are not backed up on the peer device on the network, then backing up the data on one or more network devices. If the certain number of copies of the data are backed up on the peer device of the network, then not backing up the data on the one or more network devices.