Video Stream Frame Correction for Unstable Network Playback

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional video streaming systems face issues with unstable network conditions, leading to lost or delayed frames, which result in a jumpy and inconsistent viewing experience due to freezing or interrupting the video stream.

Innovation Solution

The system detects transmission interruptions by analyzing frame timestamps and inserts correction frames, including repetitions and interpolations, to maintain a stable output video stream without freezing or interrupting the presentation, thereby reducing the visibility of transmission issues.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If conventional video streaming systems freeze or interrupt the video stream to handle lost frames, then transmission stability is improved, but viewing smoothness deteriorates

Engineering Contradiction:
Improvetransmission stabilityVSAvoidviewing smoothness
Core Design Contradiction:
ReliabilityVSDuration of action of moving object

Solution Approach 1:

The system performs preliminary actions by detecting lost frames through timestamp analysis and proactively inserting correction frames (repetition or interpolation) before the video stream would naturally freeze or interrupt. This preventive approach maintains both transmission reliability and viewing smoothness simultaneously.

Inventive Principle:
Principle #10Preliminary action

2Duration of action of moving object

If correction frames are inserted to maintain continuous playback, then viewing smoothness is improved, but transmission reliability deteriorates

Engineering Contradiction:
Improveviewing smoothnessVSAvoidtransmission accuracy
Core Design Contradiction:
Duration of action of moving objectVSReliability

Solution Approach 1:

The system introduces correction frames as intermediary elements between the original video frames. These correction frames (either repetitions or interpolations) act as mediators that bridge gaps caused by lost frames, maintaining both viewing smoothness and transmission reliability by providing a seamless transition.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Reliability

If placeholder images or videos are inserted to indicate transmission issues, then transmission reliability is improved, but user experience deteriorates

Engineering Contradiction:
Improvetransmission monitoringVSAvoiduser experience
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The system converts the harmful effect of transmission interruptions into a beneficial outcome by using lost frame detection as an opportunity to insert correction frames. Instead of displaying annoying placeholders that alert users to problems, the system silently corrects the issues and maintains smooth playback, turning a potential negative experience into a seamless viewing process.

Inventive Principle:
Principle #22Blessing in disguise (Convert harm into benefit)

Data Source

PatentUS10243694B1Output frame correction for unstable video streams
Publication Date: 2019.03.26 TWITCH INTERACTIVE INC
  • US10243694B1 patent drawing
  • US10243694B1 patent drawing
  • US10243694B1 patent drawing

AI summary

Techniques for output frame correction for unstable video streams are described herein. A video item may be transmitted via an input video stream from a first entity to a second entity over one or more electronic communications networks. The incoming frames from the input video stream may then be used, by the second entity, to generate an output video stream for presentation to one or more viewers. The transmission of the input video stream may temporarily become unstable and may be interrupted such that one or more frames of the input video stream are delayed and/or lost. When a transmission interruption is detected, the output video stream may be adjusted by inserting one or more correction frames into the output video stream. The inserted correction frames may include one or more repetitions of one or more prior frames in the output video stream and/or one or more interpolated frames.