Live Media Encoding Failover via Load Balancer Intermediary

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional live media encoding systems experience interruptions and degrade user experience when components fail, as they require time-consuming updates and reconfiguration to redirect live streams to backup components, leading to potential data synchronization issues and unsynchronized data packets.

Innovation Solution

The live media encoding system automatically detects failed components using a gossip protocol and implements failover actions by decoupling and recoupling network interfaces and load balancers to redirect streams without requiring updates to the contribution encoder, ensuring continuous transmission and minimizing interruptions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If conventional live media encoding systems redirect streams to backup components upon failure, then system reliability is improved, but stream interruption time increases and user experience degrades

Engineering Contradiction:
Improvesystem reliabilityVSAvoidstream interruption time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system performs preliminary actions by pre-configuring backup encoders and maintaining standby encoding resources before failures occur. When a primary encoder fails, the backup encoder is already prepared and can immediately take over, eliminating the need for time-consuming reconfiguration and reducing stream interruption time while maintaining high system reliability

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system introduces an intermediary load balancer that sits between contribution encoders and packaging ingest devices. This load balancer automatically detects encoder failures and redirects traffic to backup encoders without requiring updates to contribution encoders, enabling seamless failover that maintains reliability while minimizing interruption time

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If conventional systems update contribution encoder parameters to redirect streams, then stream redirection is achieved, but system complexity and configuration time increase

Engineering Contradiction:
Improvestream redirection capabilityVSAvoidconfiguration complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The load balancer acts as an intermediary that absorbs the complexity of stream redirection logic. Contribution encoders simply send streams to the load balancer, which automatically routes them to appropriate backup encoders based on failure detection, eliminating the need for complex parameter updates at the contribution encoder level while maintaining flexible stream redirection capability

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system implements self-service through automated failure detection and failover mechanisms. The load balancer and backup encoders automatically detect failures and redirect streams without human intervention or complex configuration changes, reducing system complexity while maintaining adaptability for various failure scenarios

Inventive Principle:
Principle #25Self-service

3Reliability

If backup encoders are activated upon failure, then service continuity is improved, but data synchronization issues and packet desynchronization occur

Engineering Contradiction:
Improveservice continuityVSAvoiddata synchronization accuracy
Core Design Contradiction:
ReliabilityVSLoss of information

Solution Approach 1:

The system implements feedback mechanisms where the load balancer continuously monitors encoder status and stream data flow. When activating backup encoders, the system receives feedback about stream state and adjusts synchronization accordingly, ensuring that data packets remain synchronized and preventing information loss while maintaining service continuity

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

Backup encoders are pre-configured with the same encoding parameters and stream routing information before failures occur. This preliminary preparation ensures that when backup encoders are activated, they can immediately process streams with correct synchronization settings, preventing data packet desynchronization while ensuring service continuity

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11005702B2Live media encoding failover system
Publication Date: 2021.05.11 AMAZON TECH INC
  • US11005702B2 patent drawing
  • US11005702B2 patent drawing
  • US11005702B2 patent drawing

AI summary

An encoding system that distributes a live stream to end user devices is provided herein. The encoding system automatically detects failed components and implements a failover action to replace the failed component with a backup component in a manner that reduces live stream interruptions. For example, the encoding system can include a network interface that is coupled to an encoder allocated to a live stream. Instead of providing a contribution encoder that transmits the live stream with a location of the allocated encoder, the encoding system can provide the contribution encoder with a location of the network interface. Thus, the contribution encoder can transmit the live stream to the network interface. The network interface can then forward the live stream to the allocated encoder. If the allocated encoder fails, then the network interface can forward the live stream to a backup encoder.