Subpicture Video Coding for Partial Display and Efficient Decoding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The increasing size, resolution, and frame rate of video data necessitate improved compression techniques with better encoding efficiency and higher image quality, and there is a need for technologies that allow partial display of decoded pictures, especially with the advent of applications like 360 video.
Innovation Solution
Partitioning each picture into independently displayable subpictures and encoding and decoding each subpicture, utilizing tree structures like QuadTree, BinaryTree, and TernaryTree for block splitting, and employing intra- and inter-prediction methods to generate and reconstruct subpictures.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If video data is compressed using existing techniques (H.264/AVC, HEVC), then the data can be stored or transmitted, but the encoding efficiency and image quality are insufficient for increasingly large video sizes, resolutions, and frame rates
Solution Approach 1:
The patent divides each picture into multiple subpictures, and each subpicture is further divided into multiple tiles. This hierarchical segmentation allows independent encoding and processing of smaller regions, improving encoding efficiency and enabling parallel processing to handle larger video data sizes effectively.
Solution Approach 2:
The patent introduces a new dimensional organization by creating a hierarchical structure with subpictures and tiles within pictures. This multi-level partitioning adds structural dimensions to the encoding process, allowing more flexible and efficient handling of increasing video resolution and frame rate requirements.
2Reliability
If the entire picture is decoded and stored, then complete video data is available, but hardware resources including memory are significantly consumed
Solution Approach 1:
By segmenting pictures into subpictures and tiles, the patent enables selective decoding and storage of only the required portions of video data. This reduces memory resource consumption while maintaining the ability to access complete video data when needed, as the segmented structure allows on-demand retrieval.
3Quantity of substance
If video data is compressed to reduce data size, then storage and transmission requirements are reduced, but image quality may deteriorate
Solution Approach 1:
The patent applies different encoding parameters and prediction modes to different subpictures and tiles based on their local characteristics. This local quality approach allows optimized compression for each region, maintaining higher overall image quality while achieving effective data size reduction through adaptive local processing.
4Device complexity
If traditional picture partitioning is used, then encoding is simplified, but independent display of partial regions is not enabled
Solution Approach 1:
The patent segments pictures into subpictures and tiles with well-defined boundaries and hierarchical relationships. This segmentation structure enables independent display of partial regions while maintaining a relatively simple encoding framework, as each segment can be independently processed and displayed without requiring complex inter-segment dependencies.
Solution Approach 2:
The patent creates a dynamic partitioning structure where subpictures and tiles can be independently configured and displayed. This dynamic organization allows the system to adapt to different display requirements (full picture or partial regions) while maintaining a manageable encoding complexity through standardized segment interfaces.
Data Source
AI summary
For encoding and decoding images, an image encoding device divides each picture into sub-pictures that can be independently displayed, and signals layout information about the sub-pictures, and an image decoding device identifies each sub-block through the layout information and decodes the sub-pictures. A video decoding apparatus and method are configured to decode a bitstream containing an encoded sequence of pictures which are partitioned into a plurality of subpictures including a plurality of coding tree blocks.