Multicast Tree Latency Optimization via Hierarchical Node Segmentation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current broadcast video systems over computer networks face efficiency and latency challenges, particularly when multiple users attempt to view the same media event simultaneously, leading to issues with synchronization and resource management.

Innovation Solution

A low latency multicast network system is implemented using a master node and helper nodes in a one-to-many relationship, where network latency is measured, and routing tables are created to optimize data streaming, allowing for dynamic reconfiguration and adjustment of bandwidth and latency thresholds to ensure synchronized media delivery.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If traditional broadcast video systems are used over computer networks, then media content can be delivered to multiple users, but latency increases and synchronization becomes difficult when multiple users view the same media event simultaneously

Engineering Contradiction:
ImprovesynchronizationVSAvoidlatency
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system segments the network into a hierarchical structure with master nodes and helper nodes. Master nodes receive media content directly from sources and distribute it to helper nodes, which then serve local users. This segmentation reduces latency by distributing content through multiple parallel paths rather than a single centralized broadcast channel, enabling synchronized delivery to multiple users simultaneously.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces a hierarchical dimension to the network architecture, organizing nodes into multiple levels (master nodes at higher levels, helper nodes at lower levels). This dimensional organization allows content to flow downward through the hierarchy, reducing the time required for distribution across the network while maintaining synchronization through coordinated timing at each hierarchical level.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Productivity

If multiple users access media content simultaneously through traditional broadcast systems, then content delivery is achieved, but network resource management becomes inefficient

Engineering Contradiction:
Improvecontent delivery efficiencyVSAvoidnetwork resource consumption
Core Design Contradiction:
ProductivityVSLoss of energy

Solution Approach 1:

The system creates distributed copies of media content at multiple nodes throughout the network. Helper nodes store local copies of content received from master nodes, enabling users to access content from the nearest available node rather than requiring all users to connect to the original source. This copying mechanism improves delivery efficiency while reducing overall network resource consumption by eliminating redundant transmissions.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The system performs preliminary actions by pre-fetching and caching media content at helper nodes before users request it. When content becomes available at a master node, it is proactively distributed to helper nodes in advance, so that when users request the content, it is already available locally, improving delivery efficiency and reducing real-time network resource consumption.

Inventive Principle:
Principle #10Preliminary action

3Device complexity

If a centralized broadcast system is used, then media distribution is simplified, but the system cannot reliably manage networking resources while providing low latency streams to multiple customers

Engineering Contradiction:
Improvesystem structureVSAvoidresource management
Core Design Contradiction:
Device complexityVSReliability

Solution Approach 1:

The centralized system is segmented into distributed master and helper nodes, each with autonomous resource management capabilities. This segmentation maintains operational simplicity through standardized node functions while improving reliability by distributing resource management across multiple independent nodes, preventing single-point failures and enabling more reliable low-latency streams to multiple customers.

Inventive Principle:
Principle #1Segmentation

4Productivity

If traditional unicast streaming is used for each user, then individual content delivery is achieved, but network bandwidth consumption increases significantly

Engineering Contradiction:
Improvecontent delivery capabilityVSAvoidnetwork bandwidth
Core Design Contradiction:
ProductivityVSQuantity of substance

Solution Approach 1:

The system merges multiple unicast streams into efficient multicast transmissions. When multiple users request the same content, the master node creates a single multicast stream that is distributed to multiple helper nodes simultaneously, which then serve their respective users. This merging approach maintains individual content delivery capability while dramatically reducing network bandwidth consumption by eliminating redundant transmissions of identical content.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS10284381B1Low latency data distribution in a computing service environment
Publication Date: 2019.05.07 AMAZON TECH INC
  • US10284381B1 patent drawing
  • US10284381B1 patent drawing
  • US10284381B1 patent drawing

AI summary

A master node may be configured with helper nodes in a one-to-many structure in a multicast tree for data streaming. A master node may receive network requests from the helper nodes in order to construct a pingback response. A master node may establish a network latency, for each of the helper nodes according to the pingback responses, to form a broadcast timing index. A master node may create routing tables from the broadcast timing index for local multicast routing at helper nodes within the multicast tree. A master node may send the routing tables from the master node to each of the helper nodes to arrange helper nodes in proximity to one another and create helper tiers within the multi-cast tree. A master node may stream data from the master node to the helper nodes according to a center-to-edge order of the multicast tree based on the routing table.