Subpicture CTU Position Encoding for Faster Video Coding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video coding technologies face challenges in efficiently processing increasing amounts of digital video data, particularly in identifying and processing subpicture regions within video frames, leading to difficulties in coding efficiency, image quality, processing amount, and processing speed.
Innovation Solution
The encoder and decoder systems utilize subpicture information represented using coding tree units (CTUs) to define and encode/decode subpicture regions flexibly across multiple frames, allowing for efficient representation of horizontal and vertical locations, reducing code amount, and enabling appropriate identification of processing regions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If conventional video coding standards (H.264/AVC, HEVC, VVC) are used to process digital video data, then video coding capability is provided, but coding efficiency and processing speed are insufficient for increasing amounts of digital video data
Solution Approach 1:
The picture is divided into multiple subpictures, and each subpicture is further divided into multiple tiles. This hierarchical segmentation allows parallel processing of different subpictures and tiles, improving processing speed and efficiency while managing coding complexity through modular structure.
Solution Approach 2:
The patent introduces a new dimension for organizing video data by creating a multi-level hierarchy (picture → subpicture → tile → CTU) rather than processing the entire picture as a single unit. This dimensional organization enables more efficient memory management and parallel processing operations.
2Productivity
If subpicture regions are identified and processed within video frames, then coding efficiency can be improved, but processing amount and circuit scale increase
Solution Approach 1:
Subpicture information including tile information is encoded in advance and stored for later use. This preliminary encoding of spatial organization data allows the decoder to efficiently identify and process specific regions without requiring complex real-time analysis, reducing processing amount while maintaining coding efficiency.
Solution Approach 2:
The patent introduces subpicture information as an intermediary data structure that bridges the relationship between the overall picture structure and individual tile/CTU elements. This intermediary layer simplifies region identification and processing by providing pre-organized spatial information.
3Measurement precision
If horizontal and vertical positions of CTUs are represented relative to picture ends, then subpicture regions can be precisely identified, but code amount increases
Solution Approach 1:
The picture coordinate system is segmented into multiple subpictures, each with its own tile structure. By representing CTU positions relative to subpicture or tile boundaries rather than the entire picture, the patent achieves precise position identification with fewer bits, reducing code amount while maintaining accuracy.
Solution Approach 2:
Different coordinate reference systems are applied to different regions: positions within subpictures are represented relative to subpicture boundaries, while positions within tiles are represented relative to tile boundaries. This local quality approach optimizes code efficiency for each hierarchical level.
Data Source
AI summary
An encoder includes circuitry and memory coupled to the circuitry. In operation, the circuitry encodes subpicture information in which a horizontal position and a vertical position of a region of a subpicture are represented in a unit of a coding tree unit (CTU). The subpicture is a rectangular region in a picture. The horizontal position is represented by a first position of a first CTU in the subpicture, the first position being relative to a left end of the picture. The vertical position is represented by a second position of a second CTU in the subpicture, the second position being relative to a top end of the picture.