Live Encoder Failover Handoff for Seamless Video Streaming

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing streaming technologies face challenges in minimizing downtime during the replacement of encoding machine instances, which can lead to video lag, repeating frames, or loss of video signal, especially in long-running workflows, due to the need for security updates and operational reasons.

Innovation Solution

A failover handoff process that dynamically analyzes and prepares resources for a seamless transition by pre-warming and initializing a new encoding instance, allowing for passive migration of network resources without explicit coordination, ensuring continuous video streaming and maintaining system integrity.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If a machine instance backing a running encoder is replaced for security or operational reasons, then the system can be updated and kept secure, but downtime occurs causing video lag, repeating frames, or loss of video signal

Engineering Contradiction:
Improvesystem security and operational integrityVSAvoiddowntime during encoder replacement
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent applies preliminary action by pre-warming and initializing the replacement encoding instance before the current instance is taken offline. This includes pre-configuring the replacement instance with necessary software updates and testing its functionality in advance, so that when the failover occurs, the replacement instance is already ready to immediately assume the encoding workload without requiring startup time or initialization delays.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent uses an intermediary approach by introducing a failover mechanism that mediates between the current encoding instance and the replacement instance. This intermediary system manages the transition process, including monitoring the current instance's health, triggering the failover when necessary, and coordinating the handoff of encoding responsibilities to the replacement instance, thereby minimizing disruption to the streaming workflow.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If the encoding instance is replaced frequently for security updates, then the system remains secure and up-to-date, but the frequency of disruptions increases affecting long-running workflows

Engineering Contradiction:
Improvesystem security postureVSAvoidcontinuity of long-running workflows
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent applies the copying principle by creating and maintaining a standby replacement instance that is a copy or clone of the current encoding instance. This replacement instance is prepared in advance with updated software and configurations, serving as a ready-made substitute. When security updates are needed, the pre-prepared copy can immediately take over without requiring time-consuming updates during the actual failover, thus maintaining both security and workflow continuity.

Inventive Principle:
Principle #26Copying

3Adaptability or versatility

If software updates are applied during encoder operation, then the system stays current, but video quality may be compromised during the update process

Engineering Contradiction:
Improvesoftware update capabilityVSAvoidvideo encoding quality
Core Design Contradiction:
Adaptability or versatilityVSManufacturing precision

Solution Approach 1:

The patent applies segmentation by separating the software update process from the active encoding process. The replacement instance undergoes software updates and testing in isolation while the current instance continues to encode video without interruption. Once the replacement instance is fully updated and validated, it takes over the encoding workload, ensuring that video encoding quality is never compromised during the update process itself.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS11824910B2Network failover for migrating live encoders
Publication Date: 2023.11.21 AMAZON TECH INC
  • US11824910B2 patent drawing
  • US11824910B2 patent drawing
  • US11824910B2 patent drawing

AI summary

Systems and methods perform a failover, handoff type of process for machines actively encoding and transcoding media content or other data, including live video. Based on dynamic analyses, including detection of needed updates due to security anomalies and encoder state evaluations, the encoder instance initially receiving a stream can restart following handoff to another encoder instance. System downtime is minimized through actions such as initializing the replacement encoder and passively migrating network resources to same, without any explicit coordination or messaging between the two instances.