Subpicture Layout for Adaptive Resolution in Video Frames
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current video coding technologies face challenges in efficiently signaling adaptive resolution changes across multiple semantically independent picture parts within a single video frame, particularly in 360-degree video and surveillance applications, where different parts of the scene require separate adaptive resolution settings to manage varying activity levels.
Innovation Solution
The proposed solution involves a method and apparatus that parse video parameter sets to determine picture order counts and access unit counts, allowing for the setting of video data into enhancement layers with adaptive resolution changes, enabling independent resolution settings for different parts of the video frame through the use of sub-picture partitioning and signaling of ARC parameters in the video bitstream.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If adaptive resolution changes are applied to different parts of a video frame independently, then compression efficiency is improved, but device complexity increases due to multiple semantically independent picture parts requiring separate settings
Solution Approach 1:
The video frame is divided into multiple semantically independent picture parts (subpictures), each of which can have independent adaptive resolution change parameters. This segmentation allows different regions to be processed at different resolutions based on their semantic importance and activity levels, improving compression efficiency while maintaining manageable complexity through modular parameter handling.
2Adaptability or versatility
If multiple semantically independent picture parts are used with separate adaptive resolution settings, then adaptability is improved, but difficulty of detecting and measuring increases due to need to track multiple parameters
Solution Approach 1:
Adaptive resolution change parameters are signaled in advance in the video bitstream for each semantically independent picture part. This preliminary signaling allows the decoder to prepare and allocate resources appropriately before decoding each picture part, reducing the real-time complexity of parameter detection and measurement while maintaining high adaptability.
3Adaptability or versatility
If subpicture partitioning is implemented for temporal and spatial scalability, then adaptability is improved, but device complexity increases due to additional signaling requirements
Solution Approach 1:
Different quality levels and resolution settings are applied to different subpicture regions based on their local characteristics and importance. This local quality approach enables temporal and spatial scalability where important regions maintain higher quality while less important regions use lower resolution, achieving adaptability without uniformly increasing complexity across the entire picture.
Data Source
AI summary
There is included a method and apparatus comprising computer code configured to cause a processor or processors to perform obtaining video data, parsing a video parameter set (VPS) syntax of the video data, determining whether a value of a syntax element of the VPS syntax indicates a picture order count (POC) value of an access unit (AU) of the video data, and setting at least one of a plurality of pictures, slices, and tiles of the video data to the AU based on the value of the syntax element.