Backward Extrapolation for Video Stream Decoding Delays

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Delays in decoding and presentation of digital audiovisual content occur due to the absence of time stamp information for certain compressed pictures in video streams, particularly during stream transition events like channel changes in IPTV networks, leading to inefficiencies in viewer experience.

Innovation Solution

The implementation of a time stamp extrapolation system that receives and caches compressed pictures without time stamp information, determines a backwards extrapolation period based on subsequent time stamp information, and computes extrapolated time stamp information for these pictures, enabling decoding and presentation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If compressed pictures without time stamp information are received during stream transition events, then the video stream can be received continuously, but decoding and presentation delays occur due to inability to process these pictures

Engineering Contradiction:
Improvedecoding speedVSAvoiddecoding delay
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The patent applies preliminary action by calculating and storing backward extrapolation periods (BEP) in advance based on picture timing information that is received later. The system pre-computes the time relationships between pictures and stores these extrapolation parameters, so that when pictures without time stamps are encountered during stream transitions, the decoding process can immediately use the pre-calculated BEP values to determine presentation timing without waiting for subsequent time stamp information, thereby reducing decoding delays.

Inventive Principle:
Principle #10Preliminary action

2Reliability

If time stamp information is awaited for each compressed picture before decoding, then decoding accuracy is improved, but presentation delays increase particularly during stream transitions

Engineering Contradiction:
Improvedecoding accuracyVSAvoidpresentation delay
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent introduces an intermediary mechanism by using backward extrapolation period (BEP) calculations as a mediator between received pictures and the decoding process. When time stamp information is unavailable for certain pictures, the system uses BEP values derived from subsequently received pictures to interpolate and determine the timing information for earlier pictures. This intermediary approach allows decoding to proceed with estimated timing information rather than waiting for actual time stamps, thus reducing presentation delays while maintaining acceptable decoding accuracy.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Reliability

If all compressed pictures are cached before processing, then decoding reliability is improved, but memory requirements and processing time increase

Engineering Contradiction:
Improvedecoding reliabilityVSAvoidbuffer management complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent applies preliminary action by pre-calculating and storing backward extrapolation period (BEP) values based on picture timing information that becomes available later in the stream. Instead of caching all pictures indefinitely or waiting for complete time stamp information, the system pre-computes the time relationships and stores these extrapolation parameters, enabling selective processing of pictures based on their extrapolated timing information. This reduces the need to hold all pictures in memory and simplifies buffer management while maintaining decoding reliability.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS8731000B2Decoding earlier frames with DTS/PTS backward extrapolation
Publication Date: 2014.05.20 TRITON US VP ACQUISITION CO
  • US8731000B2 patent drawing
  • US8731000B2 patent drawing
  • US8731000B2 patent drawing

AI summary

In one method embodiment, receiving a video stream comprising a first compressed picture without associated time stamp information and a second compressed picture having associated first time stamp information, the second compressed picture following the first compressed picture in transmission order; deriving second time stamp information based on the first time stamp information; and processing the first compressed picture based on the second time stamp information.