Immersive Video Atlas Filtering via Metadata Analysis
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In traditional immersive video coding systems, resources such as bandwidth and processing power are wasted by decoding all atlases in a bitstream, even though only a portion of the views are utilized for rendering.
Innovation Solution
A media aware network element (MANE) is used to filter out atlases that are not needed for rendering, by processing SEI messages and metadata to determine which atlases correspond to views of interest, and only decoding those atlases.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If all atlases in the bitstream are decoded, then complete view information is available for rendering, but bandwidth and processing resources are wasted
Solution Approach 1:
The patent extracts and processes metadata from SEI messages to identify which atlases contain views of interest. The system selectively extracts only the necessary atlas data required for rendering, discarding unnecessary atlases. This extraction approach resolves the contradiction by maintaining complete view information for needed views while eliminating waste of bandwidth and processing resources on unnecessary atlases.
2Loss of energy
If selective filtering of atlases is implemented, then bandwidth and processing resources are conserved, but complexity of bitstream processing increases
Solution Approach 1:
The patent performs preliminary processing of SEI messages and metadata before the main decoding process. By advance identifying which atlases contain views of interest and preparing the necessary view information in advance, the system reduces the complexity of the main decoding process. This preliminary action resolves the contradiction by conserving bandwidth and processing resources while managing processing complexity through advance preparation.
Data Source
AI summary
Methods, apparatus, systems and articles of manufacture to sample enabled views per atlas in immersive video are disclosed. An example apparatus includes an interface to obtain a bitstream corresponding to an immersive video; a bitstream analyzer to determine that metadata corresponding to an atlas of the bitstream identifies that at least part of a view of interest corresponds to the atlas, the metadata included in the bitstream; and a filter to generate a filtered bitstream by removing atlases that do not identify at least part of a view of interest from the bitstream, the interface to provide the filtered bitstream to a decoder.