Subpicture Video Coding Layout for Partial Region Decoding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The increasing size, resolution, and frame rate of video data necessitate improved compression techniques with better encoding efficiency and higher image quality, and there is a need for technologies that can display partial regions of decoded pictures, especially with the advent of applications like 360 video.
Innovation Solution
The method involves partitioning each picture into independently displayable subpictures and encoding and decoding each subpicture, utilizing tree structures like QuadTree, BinaryTree, and TernaryTree for block splitting, and employing intra- and inter-prediction to generate and reconstruct subpictures.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If video data is compressed using existing techniques (H.264/AVC, HEVC), then the amount of data is reduced, but encoding efficiency and image quality need further improvement as video size, resolution, and frame rate increase
Solution Approach 1:
The picture is divided into multiple subpictures, each independently encodable and decodable. This segmentation allows parallel processing and independent optimization of each subpicture, improving overall encoding efficiency while maintaining high image quality through focused compression on each region
Solution Approach 2:
Different subpictures can be encoded with different quality levels and compression parameters based on their importance and content characteristics. This allows critical regions to maintain higher quality while less important regions use more aggressive compression, optimizing the overall quality-efficiency balance
2Reliability
If the entire picture is decoded and stored, then complete video data is available, but significant hardware resources including memory are required
Solution Approach 1:
Only the necessary subpictures are decoded and stored based on application requirements, rather than decoding the entire picture. This extraction approach significantly reduces memory resources while maintaining data reliability for the required regions
Solution Approach 2:
By segmenting the picture into independent subpictures, the system can selectively decode and store only the required portions, reducing overall memory requirements while ensuring complete data availability for needed regions
3Adaptability or versatility
If subpictures are partitioned and independently processed, then partial picture regions can be displayed independently, but the decoding process becomes more complex
Solution Approach 1:
The picture is segmented into independent subpictures that can be decoded and displayed separately. This segmentation enables flexible display capabilities including partial picture display and independent subpicture rendering, while the modular structure manages complexity through standardized processing units
4Manufacturing precision
If high resolution and frame rate are maintained, then video quality is preserved, but the amount of data to be encoded increases
Solution Approach 1:
By dividing the high-resolution picture into multiple subpictures, the encoding process can apply optimized compression to each segment while maintaining overall video quality. This segmentation enables efficient processing of large data volumes through parallel and independent compression of each subpicture region
Data Source
AI summary
For encoding and decoding images, an image encoding device divides each picture into sub-pictures that can be independently displayed, and signals layout information about the sub-pictures, and an image decoding device identifies each sub-block through the layout information and decodes the sub-pictures. A video decoding apparatus and method are configured to decode a bitstream containing an encoded sequence of pictures which are partitioned into a plurality of subpictures including a plurality of coding tree blocks.