Selective Data Replication via Zone-Based Subscription

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In networked computer environments, the existing data replication methods consume excessive network and computing bandwidth as the number of objects and nodes increases, leading to interference with the intended network processing.

Innovation Solution

The system selectively distributes data by assigning computing nodes to zones based on their functions and replicating data only to nodes that require it, using a subscription model where nodes request and unsubscribe from specific data objects as needed, reducing unnecessary data movement and storage.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If all data is replicated to all nodes in the network, then each node has ready access to data, but network bandwidth and computing bandwidth are excessively consumed

Engineering Contradiction:
Improvedata access speedVSAvoidnetwork bandwidth consumption
Core Design Contradiction:
SpeedVSLoss of energy

Solution Approach 1:

The patent applies local quality by making different parts of the network have different data replication characteristics. Specifically, data objects are selectively replicated to different zones based on their access patterns and characteristics. Some zones receive full replication while others receive partial or no replication, optimizing the balance between access speed and bandwidth consumption for each local region of the network.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The network is segmented into multiple zones, and data replication is performed selectively within each zone rather than uniformly across the entire network. This segmentation allows the system to control which nodes receive data copies, thereby reducing overall network bandwidth consumption while maintaining fast access for nodes that require the data.

Inventive Principle:
Principle #1Segmentation

2Productivity

If all data is replicated to all nodes in the network, then each node has ready access to data, but network processing is interfered with

Engineering Contradiction:
Improvedata access efficiencyVSAvoidnetwork congestion
Core Design Contradiction:
ProductivityVSObject-generated harmful factors

Solution Approach 1:

The patent implements local quality by tailoring data replication to the specific needs of each network zone. Data objects are replicated to zones where they are actually needed based on access patterns, rather than being distributed universally. This reduces network congestion and eliminates the harmful effect of unnecessary data transmission while maintaining high data access efficiency for nodes that require the data.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent applies partial action by replicating only the necessary portion of data to the necessary nodes, rather than performing full replication across the entire network. This selective replication approach reduces network congestion and eliminates harmful effects of excessive data transmission while still providing adequate data access for nodes that need it.

Inventive Principle:
Principle #16Partial or excessive action

3Loss of energy

If data is selectively replicated only to specific nodes, then bandwidth usage is minimized, but nodes may not have ready access to data they need

Engineering Contradiction:
Improvenetwork bandwidth consumptionVSAvoiddata access speed
Core Design Contradiction:
Loss of energyVSSpeed

Solution Approach 1:

The patent applies preliminary action by proactively replicating data objects to zones where they are likely to be needed based on historical access patterns and predicted future requirements. This anticipatory replication ensures that data is available with minimal delay when nodes need it, while still maintaining selective replication to control bandwidth consumption.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system uses feedback mechanisms to monitor data access patterns and dynamically adjust replication decisions. When nodes access data objects, this information is fed back to the replication management system, which then makes informed decisions about whether to replicate additional copies to specific zones, thereby optimizing both access speed and bandwidth usage based on actual usage patterns.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS10545989B1Selective data replication
Publication Date: 2020.01.28 AMAZON TECH INC
  • US10545989B1 patent drawing
  • US10545989B1 patent drawing
  • US10545989B1 patent drawing

AI summary

Computer implemented systems and methods for distributing replica chunks are disclosed. Computing nodes in the network are assigned to zones that correspond to functions performed by the nodes in the network. Replica chunks are likewise associated with the zones that are typically used in processing the replica chunks. When the owner of a replica chunk identifies a new node, it distributes to the new node those replica chunks that are associated with a zone that matches the zone associated with the new node. The owner of the replica chunk is further programmed to receive requests from nodes to subscribe to a data chunk. The node replicates the data chunk to those nodes in the network that have subscribed to the data chunk. When a node no longer requires access to a data chunk, the node unsubscribes from receiving the data chunk.