HEIF Container Decodability Indicators for Predictive Frame Selection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The HEIF file format requires a transcoding operation to select a predictively coded frame as a primary image item, which consumes additional processing resources and increases file size, as predictively coded frames (P or B frames) are not self-decodable and depend on other frames.
Innovation Solution
Incorporating a decodability indicator and dependence information within the container to identify whether an image item is self-decodable or dependent on other items, and if dependent, specifying the dependent items, allowing for efficient decoding of predictively coded frames without transcoding and reducing file size.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If a predictively coded frame (P or B frame) is selected as a primary image item in HEIF file format, then the file size is reduced and processing efficiency is improved, but the frame cannot be decoded without reference to other frames, violating the self-decodable requirement
Solution Approach 1:
The patent segments the video data into individual image items within the HEIF container, each with its own decodability indicator. This allows the system to treat predictively coded frames as selectable primary items while maintaining the ability to decode them by referencing other image items stored in the same container, thus resolving the contradiction between self-decodability requirement and predictive coding efficiency.
Solution Approach 2:
The patent introduces an intermediary data structure (the container with decodability indicators and dependence information) that mediates between the primary image item and its reference frames. This intermediary structure enables the system to select predictively coded frames as primary items while providing the necessary reference information for decoding, without requiring full transcoding to intra-coded frames.
2Reliability
If transcoding is performed to create a self-decodable version of a predictively coded frame, then the primary image item requirement is satisfied, but additional processing resources are consumed and file size increases
Solution Approach 1:
Instead of performing full transcoding to create completely self-decodable intra-coded frames, the patent applies partial action by storing only the necessary reference frames and decodability indicators in the container. This partial approach satisfies the self-decodability requirement for primary items while avoiding the excessive processing and storage costs of complete transcoding.
Solution Approach 2:
The patent performs preliminary action by pre-organizing the video data into a container structure with decodability indicators and dependence information before the primary image item is selected. This preliminary organization enables efficient selection of predictively coded frames as primary items without requiring transcoding at the time of selection, reducing processing complexity.
3Reliability
If transcoding is performed to create a self-decodable version of a predictively coded frame, then the primary image item requirement is satisfied, but the file size increases
Solution Approach 1:
The patent extracts only the essential reference frames and decodability indicators from the full video sequence and stores them in the HEIF container. This extraction approach provides the necessary self-decodability information without including all the redundant data that would result from full transcoding, thus minimizing file size increase while satisfying the primary image item requirement.
Data Source
AI summary
A method, apparatus and computer program product are provided to include information within a container that also includes a video bitstream as to whether individual image items corresponding to the video frames of the video bitstream bitstreams are self-decodable or, alternatively, are dependent upon one or more other image items. In an instance in which a respective image item is dependent upon one or more other image items, the method, apparatus and computer program product also include dependence information within the container identifying the other image item(s)upon which the decodability of the respective image item is dependent. As such, the method, apparatus and computer program product permit decoding relationships to be defined in the container between a predictively coded frame and other image item(s)upon which the predictively coded frame is dependent, thereby facilitating the decoding of the frame and, in turn, the video bitstream.