Distributed Peer-to-Peer Backup System with Location Map
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current network data processing systems face inefficiencies in backing up and restoring data, particularly with tape-based systems being time-consuming and requiring large storage spaces, and centralized storage systems being expensive to maintain.
Innovation Solution
A method that generates an initial map of files across nodes in a network data processing system, creating a location map to identify file locations, enabling efficient backup and restoration by distributing file storage across multiple nodes and eliminating the need for costly centralized storage systems.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If tape-based backup systems are used, then storage capacity is achieved, but backup and restoration time becomes excessively long
Solution Approach 1:
The patent segments the backup system into multiple peer nodes distributed across the network, each maintaining local copies of files. This eliminates the single-point bottleneck of centralized tape systems, enabling parallel backup operations and significantly reducing backup and restoration time while maintaining adequate storage capacity across the distributed network.
Solution Approach 2:
The patent creates multiple copies of files distributed across peer nodes in the network. Instead of relying on a single centralized storage medium like tape, the system maintains redundant file copies at different locations, enabling fast local access and restoration without the time-consuming sequential access limitations of tape-based systems.
2Device complexity
If centralized storage systems are used, then data consolidation is achieved, but system cost increases significantly
Solution Approach 1:
The patent implements a self-service distributed backup architecture where peer nodes automatically participate in backup operations using their own storage resources. Each node serves itself and other nodes in the network, eliminating the need for expensive centralized storage infrastructure while maintaining data consolidation through coordinated peer-to-peer operations.
Solution Approach 2:
The patent makes each peer node multi-functional, serving as both a data source and a storage destination. Nodes can back up files to other peers, restore files from other peers, and participate in network-wide backup operations, replacing the need for dedicated expensive centralized storage systems with versatile general-purpose network nodes.
3Reliability
If distributed file storage across peer nodes is implemented, then storage cost is reduced, but system complexity increases
Solution Approach 1:
The patent introduces a location map as an intermediary data structure that tracks file locations across peer nodes. This mediator simplifies the distributed system by providing a centralized view of file locations without requiring complex peer-to-peer coordination for every operation, reducing the perceived complexity while maintaining the cost benefits of distributed storage.
4Reliability
If peer-to-peer backup is implemented, then centralized storage cost is eliminated, but file location tracking complexity increases
Solution Approach 1:
The patent performs preliminary actions by building and maintaining a location map that pre-records file locations across peer nodes before backup or restoration operations begin. This preliminary tracking infrastructure simplifies subsequent operations by providing ready-made location information, reducing the complexity of real-time file location tracking while enabling cost-effective peer-to-peer backup.
Data Source
AI summary
A method in a processing system for managing backup data on a set of nodes in a network data processing system. An inventory of files is generated on a set of nodes in the network data processing system. An initial map from the inventory is created, wherein the first initial map includes an identification of each file located on a node in the set of nodes. A location map is built from the initial map and the location map identifies a set of files and identifies each node on which a file in the set of files is located, wherein at least one node in the set of nodes is a peer node to another node in the set of nodes.