Image Decoding Device PROF Control via Slice Header Flag
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In Versatile Video Coding (Draft 6), there is no control over the ON/OFF switching of Prediction Refinement with Optical Flow (PROF) processing at the slice level, limiting the ability to manage processing load effectively between image encoding and decoding devices.
Innovation Solution
An image decoding device is designed with a decoding unit that controls the enabling/disabling of PROF processing through a flag in the slice header, allowing for precise management of PROF processing on a per-slice basis, along with similar control over Decoder-side Motion Vector Refinement (DMVR) and Bi-Directional Optical Flow (BDOF) processing.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If PROF processing is automatically applied to all blocks without slice-level control, then image quality is improved, but processing load increases and cannot be selectively reduced
Solution Approach 1:
The patent divides the video stream into slices and introduces a slice_header_flag to control PROF processing on a per-slice basis. This segmentation allows different PROF processing policies to be applied to different slices, enabling selective reduction of processing load in certain regions while maintaining high image quality in others where PROF is beneficial.
Solution Approach 2:
The patent makes the PROF processing dynamic by introducing conditional control through the slice_header_flag. The processing capability and image quality are dynamically adjusted based on the flag value, allowing the system to adapt between high-quality mode (flag=1, PROF enabled) and low-processing-load mode (flag=0, PROF disabled) for different slices.
2Manufacturing precision
If PROF processing is enabled for all slices, then image quality is maximized, but device complexity and processing capability requirements increase
Solution Approach 1:
By segmenting control at the slice level through the slice_header_flag, the patent allows the decoding device to selectively enable PROF processing only where needed. This reduces the overall processing capability requirements compared to enabling PROF for all slices, while still achieving high image quality in critical regions.
Solution Approach 2:
The patent applies local quality control by allowing different PROF processing settings for different slices based on the slice_header_flag. This enables high image quality (PROF enabled) in slices where it is most beneficial, while using simpler processing in other slices, optimizing the trade-off between image quality and device complexity.
3Device complexity
If PROF processing is disabled to reduce processing load, then device complexity is reduced, but image quality deteriorates
Solution Approach 1:
The slice_header_flag introduces dynamic control that allows the system to switch between PROF-enabled and PROF-disabled modes on a per-slice basis. This dynamic approach ensures that image quality is maintained in slices where PROF is important, while processing load is reduced in slices where it can be sacrificed, resolving the contradiction between device complexity and image quality.
Solution Approach 2:
The patent applies local quality maintenance by selectively enabling PROF processing in specific slices through the slice_header_flag. This ensures that image quality is preserved in critical regions while allowing processing load to be reduced in other regions, achieving a balanced solution rather than a global disablement.
Data Source
AI summary
An image decoding device includes: a decoding unit configured to decode a first flag which is included in a slice header and controls enabling/disabling of PROF processing from encoded data; and an affine prediction signal generation unit configured to perform the PROF processing in a case where the first flag indicates that the PROF processing is enabled in a slice corresponding to the slice header, and generate a prediction signal without performing the PROF processing in a case where the first flag indicates that the PROF processing is disabled in a slice corresponding to the slice header.