Rectangular Tile Group Structure for Independent Sub-Picture Decoding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video data compression technologies struggle with efficient referencing and processing of video stream portions, particularly in applications like omnidirectional video, where traditional slice structures are inflexible and do not support region-of-interest decoding or sub-picture extraction.
Innovation Solution
Implementing a motion-constrained tile set (MCTS) and rectangular tile group structure that allows for independent decoding and rendering of defined rectangular areas within a video stream, enabling flexible partitioning and extraction of sub-pictures, particularly in omnidirectional video applications.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If traditional slice structures are used for video data compression, then the structure is simple and easy to implement, but it is inflexible and does not support region-of-interest decoding or sub-picture extraction
Solution Approach 1:
The video picture is divided into multiple tiles, and each tile is further divided into tile groups. This hierarchical segmentation enables independent decoding of specific regions (region-of-interest) and extraction of sub-pictures without requiring complex reconfiguration of the entire decoding structure. The segmentation allows selective processing of tile groups while maintaining overall structure simplicity.
Solution Approach 2:
The patent introduces a new dimension of organization by creating tile groups that can be independently addressed and decoded. This adds a layer of abstraction between the traditional slice structure and the actual picture data, enabling flexible region-of-interest decoding and sub-picture extraction through tile group addressing without fundamentally changing the underlying slice structure.
2Adaptability or versatility
If motion-constrained tile sets are implemented for independent decoding of tile sets, then region-of-interest decoding and sub-picture extraction are enabled, but the processing complexity increases
Solution Approach 1:
Motion constraints are pre-defined and configured for tile groups before decoding occurs. The motion constraint parameters are specified in advance in the bitstream, allowing decoders to prepare for independent tile group decoding without complex runtime calculations. This preliminary configuration enables rapid extraction and independent decoding of specific tile groups.
Solution Approach 2:
The patent implements dynamic motion constraint settings that can be applied selectively to different tile groups. Motion vectors and prediction parameters are constrained independently for each tile group, allowing flexible adaptation to different decoding scenarios while maintaining efficient processing through standardized constraint mechanisms.
Data Source
AI summary
A system may identify a defined rectangular picture area and render video corresponding to the defined rectangular picture area. The system may receive a video bitstream comprising a picture having a header and may receive data specifying a structure of the picture. The system may parse the data specifying the structure of the picture for an identifier corresponding to a defined rectangular area in the first picture and for a tile index of a top left tile in the defined rectangular area. The system may determine one or more tiles comprised in the defined rectangular area based on the identifier corresponding to the defined rectangular area and the tile index of the top left tile. The system may reconstruct the picture including a sub-picture that comprises the defined rectangular area based upon the identifier corresponding to the defined rectangular area. The computing system may render the sub-picture in the defined rectangular area.