Real-Time Audio Video Encoding Stream Switching

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Real-time encoding, decoding, and transcoding platforms face disruptions due to error-prone audio inputs, often switching to lower quality streams when issues arise, leading to potential frequent switching between primary and backup feeds, which can cause output service disruptions.

Innovation Solution

A state machine-based mechanism that automatically switches between primary and backup audio or video feeds upon disruptions, using a state diagram to determine when to switch back to the primary feed based on the availability and quality of both streams, minimizing frequent switching and ensuring reliable output.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If the system automatically switches to backup feed upon primary feed disruption, then service reliability is improved, but frequent switching between primary and backup feeds causes output service disruptions

Engineering Contradiction:
Improveservice reliabilityVSAvoidoutput service disruptions
Core Design Contradiction:
ReliabilityVSObject-generated harmful factors

Solution Approach 1:

The system continuously monitors the quality and availability of both primary and backup feeds, using feedback loops to detect disruptions and make intelligent switching decisions. The state machine evaluates current feed conditions before triggering switches, ensuring that switching only occurs when necessary and that the system can detect when to switch back to primary feed.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system dynamically adjusts its behavior based on real-time conditions by implementing a state machine with multiple states (primary, backup, unknown) and transition conditions. This dynamic approach allows the system to adapt to changing feed conditions while maintaining stability by requiring specific conditions to be met before transitioning between states.

Inventive Principle:
Principle #15Dynamics

2Manufacturing precision

If the system prioritizes higher quality feeds, then output quality is improved, but frequent disruptions in high quality streams force unnecessary switches to lower quality feeds

Engineering Contradiction:
Improveoutput qualityVSAvoidservice continuity
Core Design Contradiction:
Manufacturing precisionVSReliability

Solution Approach 1:

The system performs preliminary evaluation of feed quality and stability before making switching decisions. By monitoring feeds continuously and maintaining knowledge of their historical performance, the system can distinguish between temporary disruptions and persistent quality issues, avoiding unnecessary switches to lower quality feeds.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system changes the decision parameters for switching based on the duration and frequency of disruptions. By implementing a state machine that requires sustained poor quality conditions before switching, the system adjusts its sensitivity to quality changes, preventing unnecessary switches while still maintaining high output quality when appropriate.

Inventive Principle:
Principle #35Parameter changes

3Reliability

If the system implements automatic switchback to primary feed, then service reliability is improved, but premature switchback before primary feed stability can be confirmed causes output disruptions

Engineering Contradiction:
Improveservice reliabilityVSAvoidoutput service disruptions
Core Design Contradiction:
ReliabilityVSObject-generated harmful factors

Solution Approach 1:

The system uses continuous feedback monitoring of the primary feed's quality and stability before allowing switchback. The state machine requires that the primary feed meet specific quality thresholds and remain stable for a defined period before transitioning back to primary, ensuring that switchback only occurs when the primary feed is truly ready.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system prepares for potential switchback by continuously monitoring primary feed conditions while in backup state. By evaluating primary feed stability in advance and requiring sustained good conditions before allowing switchback, the system cushions against premature transitions that would cause output disruptions.

Inventive Principle:
Principle #11Beforehand cushioning (Prior cushioning)

Data Source

PatentUS10097823B1Failure recovery for real-time audio and video encoding, decoding, and transcoding
Publication Date: 2018.10.09 HARMONIC INC
  • US10097823B1 patent drawing
  • US10097823B1 patent drawing
  • US10097823B1 patent drawing

AI summary

Approaches for recovering from a disruption in a live input stream when performing an encoding, transcoding, or decoding operation. A higher quality input stream and a lower quality input stream are received. The two streams may be an audio or video data stream. A real-time encoding, decoding, or transcoding operation is performed using the higher quality input stream. When a disruption in the higher quality input stream occurs, the real-time encoding, decoding, or transcoding operation is performed using the lower quality input stream. A state diagram that considers how long one or more of the higher quality input stream and the lower quality input stream have been available is used in transitioning from using the lower quality input stream to the higher quality input stream in the performance of the real-time encoding, decoding, or transcoding operation.