Backward Extrapolation for Video Stream Decoding Delays
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Delays in decoding and presentation of digital audiovisual content occur due to the absence of time stamp information for certain compressed pictures in video streams, particularly during stream transition events like channel changes in IPTV networks, leading to inefficiencies in viewer experience.
Innovation Solution
The implementation of a time stamp extrapolation system that receives and caches compressed pictures without time stamp information, determines a backwards extrapolation period based on subsequent time stamp information, and computes extrapolated time stamp information for these pictures, enabling decoding and presentation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If compressed pictures without time stamp information are received during stream transition events, then the video stream can be received continuously, but decoding and presentation delays occur due to inability to process these pictures
Solution Approach 1:
The patent applies preliminary action by calculating and storing backward extrapolation periods (BEP) in advance based on picture timing information that is received later. The system pre-computes the time relationships between pictures and stores these extrapolation parameters, so that when pictures without time stamps are encountered during stream transitions, the decoding process can immediately use the pre-calculated BEP values to determine presentation timing without waiting for subsequent time stamp information, thereby reducing decoding delays.
2Reliability
If time stamp information is awaited for each compressed picture before decoding, then decoding accuracy is improved, but presentation delays increase particularly during stream transitions
Solution Approach 1:
The patent introduces an intermediary mechanism by using backward extrapolation period (BEP) calculations as a mediator between received pictures and the decoding process. When time stamp information is unavailable for certain pictures, the system uses BEP values derived from subsequently received pictures to interpolate and determine the timing information for earlier pictures. This intermediary approach allows decoding to proceed with estimated timing information rather than waiting for actual time stamps, thus reducing presentation delays while maintaining acceptable decoding accuracy.
3Reliability
If all compressed pictures are cached before processing, then decoding reliability is improved, but memory requirements and processing time increase
Solution Approach 1:
The patent applies preliminary action by pre-calculating and storing backward extrapolation period (BEP) values based on picture timing information that becomes available later in the stream. Instead of caching all pictures indefinitely or waiting for complete time stamp information, the system pre-computes the time relationships and stores these extrapolation parameters, enabling selective processing of pictures based on their extrapolated timing information. This reduces the need to hold all pictures in memory and simplifies buffer management while maintaining decoding reliability.
Data Source
AI summary
In one method embodiment, receiving a video stream comprising a first compressed picture without associated time stamp information and a second compressed picture having associated first time stamp information, the second compressed picture following the first compressed picture in transmission order; deriving second time stamp information based on the first time stamp information; and processing the first compressed picture based on the second time stamp information.


