Partial Reference Frame Generation for Video Decoder Bandwidth Reduction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The high bandwidth and storage requirements for decoding video data are a challenge due to the need to store and transmit entire reference frames, even though not all parts of these frames are necessary for decoding other frames.

Innovation Solution

A video processing apparatus and method that analyzes the bitstream to determine which portions of frames are not required for decoding other frames, generating indicators to create partial reference frames that exclude unnecessary parts, thereby reducing storage and bandwidth needs.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If entire reference frames are stored and transmitted, then decoding accuracy is maintained, but bandwidth and storage requirements increase significantly

Engineering Contradiction:
Improvedecoding accuracyVSAvoidbandwidth and storage requirements
Core Design Contradiction:
ReliabilityVSQuantity of substance

Solution Approach 1:

The reference frame is segmented into multiple portions or blocks, where only the necessary portions are identified and stored/transmitted. The analysing circuitry determines which specific portions of the reference frame are required for decoding subsequent frames, and only those portions are included in the partial reference frame, thereby reducing the quantity of data while maintaining decoding accuracy.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The unnecessary portions are extracted and removed from the reference frame. The invention extracts only the essential portions of the reference frame that are required for decoding other frames, discarding the redundant data. This extraction process reduces bandwidth and storage requirements while preserving the functionality needed for accurate decoding.

Inventive Principle:
Principle #2Taking out (Extraction)

2Quantity of substance

If partial reference frames are created to reduce storage, then bandwidth and storage requirements decrease, but processing complexity increases

Engineering Contradiction:
Improvestorage requirementsVSAvoidprocessing complexity
Core Design Contradiction:
Quantity of substanceVSDevice complexity

Solution Approach 1:

The analysing circuitry performs preliminary analysis before frame reconstruction to identify which portions of the reference frame are necessary. By determining the required portions in advance (prior to reconstruction), the system can generate indicators that guide the creation of partial reference frames, thereby managing processing complexity through advance planning rather than complex real-time operations.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

Indicators are introduced as an intermediary mechanism between the analysing circuitry and the frame reconstruction processing. These indicators convey information about which portions are necessary without requiring complex direct communication or coordination, simplifying the overall processing architecture while enabling partial reference frame generation.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Quantity of substance

If analysis of bitstream is performed to identify unnecessary portions, then storage efficiency improves, but processing time increases

Engineering Contradiction:
Improvestorage efficiencyVSAvoidprocessing time
Core Design Contradiction:
Quantity of substanceVSLoss of time

Solution Approach 1:

Instead of analyzing the entire reference frame in detail, the analysing circuitry performs partial analysis focused only on identifying which portions are necessary for decoding. This partial action approach analyzes only the essential aspects of the bitstream required to determine reference frame requirements, reducing processing time while still achieving storage efficiency through selective identification of necessary data portions.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS8594177B2Reducing reference frame data store bandwidth requirements in video decoders
Publication Date: 2013.11.26 ARM LTD
  • US8594177B2 patent drawing
  • US8594177B2 patent drawing
  • US8594177B2 patent drawing

AI summary

A video processing apparatus, method and computer program are disclosed. The video processing apparatus comprises: first stage video processing circuitry for receiving a bitstream of compressed encoded video data representing a plurality of frames of video data and configured to perform one or more processing operations on the input compressed video data; analyzing circuitry configured to analyze the processed bitstream and to determine for at least one of the plurality of frames at least one portion of the at least one frame that is not required in the decoding of other frames and to generate at least one indicator indicating the at least one portion. The frame reconstruction processing circuitry is configured to perform frame reconstruction on the compressed encoded video data and to receive the at least one indicator and to generate at least one partial reference frame for use in decoding other frames from the bitstream and the at least one indicator, the frame reconstruction processing circuitry being configured to determine from the at least one indicator the at least one portion that is not required for decoding other frames and to generate the partial reference frame as a frame that does not include the at least one portion and to output the partial reference frame for use in decoding the other frames.