Video Subpicture Padding and Cropping for Coding Efficiency
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video coding technologies face challenges in efficiently processing and decoding digital video data, particularly in matching the size of subpictures to the size of associated videos, which can lead to inefficiencies in coding and decoding processes.
Innovation Solution
A decoding method that involves decoding cropping information from a bitstream to determine the amount of cropping needed for a subpicture, padding the subpicture to reach an integer multiple of a preconfigured coding unit size, and then cropping the subpicture accordingly to match its size to the associated video.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If subpicture padding is performed to match integer multiple of coding unit size, then coding efficiency is improved, but processing amount increases
Solution Approach 1:
The patent performs padding of the subpicture to reach an integer multiple of coding unit size before the decoding process. This preliminary action ensures that the subpicture dimensions are pre-adjusted to match the coding unit requirements, thereby improving coding efficiency without requiring complex runtime adjustments during decoding operations.
2Manufacturing precision
If cropping information is decoded and subpicture cropping is performed, then image quality is enhanced, but device complexity increases
Solution Approach 1:
The patent separates the image processing into distinct segments: first padding the subpicture to reach integer multiple of coding unit size, then cropping to the final display size. This segmentation allows each operation to be optimized independently, improving image quality while managing device complexity through modular processing steps.
Solution Approach 2:
By performing padding as a preliminary action before cropping, the patent ensures that the subpicture is properly aligned to coding unit boundaries before the cropping operation. This preliminary alignment simplifies the cropping process and reduces the complexity of the circuit required to handle misaligned dimensions.
3Productivity
If padding is applied to reach integer multiple of coding unit size, then coding efficiency is improved, but processing speed decreases
Solution Approach 1:
The padding operation is performed as a preliminary action during the encoding or preprocessing stage, rather than during real-time decoding. This timing strategy allows the padding to be completed in advance when processing resources are more abundant, thereby improving coding efficiency without significantly impacting real-time processing speed during playback or display.
Data Source
AI summary
A decoding method includes: decoding, from a bitstream, cropping information indicating an amount of cropping corresponding to an amount of padding of a first subpicture that is a subpicture (i) which is among a plurality of subpictures constituting a picture, (ii) in which at least one end of the subpicture is included in at least one end of the picture, (iii) to which at least one subpicture is adjacent on a side opposite to the at least one end of the subpicture, and (iv) which is padded so that a size of the subpicture reaches an integer multiple of a preconfigured coding unit size in at least one direction; decoding the first subpicture from the bitstream; and cropping the first subpicture according to the amount of cropping.