Signaling ODR Frames for Trick Mode Video Streaming

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current video streaming technologies are limited in providing efficient random access points, leading to increased bandwidth consumption and restricted user control over video playback, especially in scenarios requiring high-speed playback or precise temporal location access.

Innovation Solution

The implementation of signaling characteristics for open decoding refresh (ODR) frames and intra-coded pictures within HTTP streaming protocols, allowing clients to request and play back video data starting from specific ODR frames or intra-coded frames, thereby reducing bandwidth usage and enhancing user control through finer granularity of playback options.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If only instantaneous decoding refresh (IDR) frames are used for random access, then decoding reliability is improved, but bandwidth consumption increases and user control flexibility deteriorates

Engineering Contradiction:
Improvedecoding reliabilityVSAvoidbandwidth consumption
Core Design Contradiction:
ReliabilityVSLoss of energy

Solution Approach 1:

The patent segments the video stream into multiple random access points including both IDR frames and ODR frames, allowing selective retrieval of specific segments based on user needs. This enables the system to provide finer granularity access points while maintaining decoding reliability through proper frame selection and signaling.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces open decoding refresh (ODR) frames as a partial alternative to full IDR frames, where ODR frames provide sufficient randomness for access purposes without requiring complete decoding refresh. This partial action approach reduces the bandwidth overhead associated with full IDR frame retrieval while maintaining adequate random access functionality.

Inventive Principle:
Principle #16Partial or excessive action

2Adaptability or versatility

If more frequent random access points are provided, then user control flexibility is improved, but bandwidth consumption increases

Engineering Contradiction:
Improveuser control flexibilityVSAvoidbandwidth consumption
Core Design Contradiction:
Adaptability or versatilityVSLoss of energy

Solution Approach 1:

The patent applies different quality levels to different random access points by introducing ODR frames with specific characteristics suitable for local access needs. Not all access points require full IDR quality, so the system selectively applies higher quality decoding refresh only where needed, reducing overall bandwidth consumption while maintaining user control flexibility.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent changes the parameters of random access frames by introducing ODR frames that differ from traditional IDR frames in terms of decoding requirements and bandwidth consumption. This parameter change allows the system to provide more frequent access points with reduced bandwidth overhead by adjusting the refresh characteristics of the frames.

Inventive Principle:
Principle #35Parameter changes

3Device complexity

If traditional HTTP streaming is used without ODR signaling, then protocol simplicity is maintained, but playback precision and trick mode capability deteriorate

Engineering Contradiction:
Improveprotocol simplicityVSAvoidtemporal location access precision
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The patent implements preliminary action by pre-signaling the locations and characteristics of ODR frames and intra-coded pictures in the media stream. This advance information allows the client to prepare and request specific temporal locations efficiently, enabling precise playback control and trick mode functionality without adding significant protocol complexity during actual playback.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces signaling data as an intermediary element between the media stream and the client player. This signaling mechanism carries information about ODR frame locations and characteristics, acting as a mediator that enables precise temporal access and trick mode capability while maintaining the simplicity of the underlying HTTP streaming protocol.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentEP2589222B1Signaling video samples for trick mode video representations
Publication Date: 2021.02.24 QUALCOMM INC
  • EP2589222B1 patent drawingFigure 1
  • EP2589222B1 patent drawingFigure 2
  • EP2589222B1 patent drawingFigure 3

AI summary

This disclosure describes techniques relevant to HTTP streaming of media data. According to these techniques, a server device may signal a byte range for at least one intra-decodable (I-frame) of a video fragment. According to the techniques of this disclosure, a client device may communicate a request to a server device to retrieve the at least one I-frame based on the signaled byte range, and use the retrieved I-frame to provide a high speed version of a video presentation that includes the at least one I-frame. A high speed version of a video presentation may be a trick mode of the video presentation, such as a fast forward or fast rewind version of the video presentation.