Subpicture Video Decoding Layout for Partial Region Display
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The increasing size, resolution, and frame rate of video data require more efficient compression techniques to reduce hardware resource usage, and technologies are needed to display partial areas of decoded pictures, especially with applications like 360 video.
Innovation Solution
Partitioning each picture into independently displayable subpictures and encoding and decoding each subpicture, using tree structures like QuadTree, BinaryTree, and TernaryTree to split coding units, and applying intra- and inter-prediction methods to generate and reconstruct subpictures.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If video data is compressed using existing techniques (H.264/AVC, HEVC), then the data volume is reduced, but the image quality and encoding efficiency are insufficient for increasing video size, resolution, and frame rate
Solution Approach 1:
The picture is divided into multiple subpictures, each of which can be independently decoded and displayed. This segmentation allows for more flexible processing and transmission of video data, improving both compression efficiency and image quality for high-resolution and high-frame-rate videos
2Loss of information
If the entire picture is decoded and transmitted, then complete video information is available, but hardware resource usage and data transmission volume increase significantly
Solution Approach 1:
Only the necessary subpicture regions are extracted and transmitted based on display requirements. This allows the system to send minimal data while maintaining complete video information availability, reducing data transmission volume without losing essential video content
3Quantity of substance
If video data is compressed using traditional methods, then storage space is reduced, but hardware resource requirements increase for processing larger size, resolution, and frame rate
Solution Approach 1:
By dividing the video into subpictures that can be independently processed, the system reduces the computational complexity for each processing unit. This segmentation allows efficient handling of high-resolution and high-frame-rate videos with reduced hardware resource requirements while maintaining effective storage compression
4Quantity of substance
If partial area display is implemented for applications like 360 video, then data transmission volume is reduced, but the ability to display entire picture area is lost
Solution Approach 1:
The picture is divided into multiple subpictures that can be independently decoded and displayed. This segmentation provides flexibility to display either the entire picture by combining all subpictures or only specific regions by selecting individual subpictures, thus maintaining adaptability while reducing data transmission volume for partial display scenarios
Solution Approach 2:
The subpicture-based structure enables the system to serve multiple display scenarios universally - whether displaying the entire picture or specific regions, whether for 360 video applications or standard video. This multi-functionality maintains display flexibility while optimizing data transmission for different use cases
Data Source
AI summary
For encoding and decoding images, an image encoding device divides each picture into sub-pictures that can be independently displayed, and signals layout information about the sub-pictures, and an image decoding device identifies each sub-block through the layout information and decodes the sub-pictures. A video decoding apparatus and method are configured to decode a bitstream containing an encoded sequence of pictures which are partitioned into a plurality of subpictures including a plurality of coding tree blocks.