HEVC Image Processing Pixel Compensation Latency Reduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The sample adaptive offset (SAO) technology in the HEVC standard experiences latency and requires substantial buffering, leading to increased resource usage and costs due to its need to wait for adjacent LCUs to perform pixel compensation, which is not suitable for time-sensitive scenarios.
Innovation Solution
The image processing method divides each largest coding unit (LCU) into at least two areas, allowing for immediate pixel compensation on the current LCU using its own pixels and previously received adjacent LCU pixels, reducing the need for buffering and latency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If the SAO compensator waits for adjacent LCUs to be received before performing pixel compensation, then compensation accuracy is improved, but processing latency increases and time sensitivity deteriorates
Solution Approach 1:
The patent segments the LCU processing into two distinct phases: an offline phase where compensation parameters are determined using pixels from the current LCU and adjacent LCUs, and an online phase where pixel compensation is performed immediately using pre-calculated parameters. This segmentation allows accurate parameter determination without delaying the actual compensation process, resolving the contradiction between compensation accuracy and processing latency.
2Measurement precision
If the SAO compensator buffers adjacent LCUs to determine compensation parameters, then parameter determination accuracy is improved, but buffering requirements and resource occupation increase
Solution Approach 1:
The patent separates parameter determination from compensation execution into offline and online phases. During the offline phase, the system buffers adjacent LCUs to accurately determine compensation parameters. Once parameters are determined, they are stored and reused during the online phase without requiring continuous buffering of adjacent LCUs. This segmentation reduces the buffering requirements while maintaining parameter determination accuracy.
3Reliability
If the SAO compensator processes the entire current LCU before moving to the next, then processing completeness is ensured, but processing speed and productivity decrease
Solution Approach 1:
The patent segments LCU processing into offline parameter determination and online compensation execution. During the offline phase, parameters for the entire current LCU are determined using pixels from the current LCU and adjacent LCUs. In the online phase, pixel compensation is performed immediately for the current LCU using pre-calculated parameters, allowing the system to proceed to the next LCU without waiting for complete processing of the current one. This segmentation ensures processing completeness while improving processing speed.
4Measurement precision
If the SAO compensator uses pixels from adjacent LCUs for compensation, then compensation quality is improved, but device complexity and operational complexity increase
Solution Approach 1:
The patent segments the use of adjacent LCU pixels into the offline phase only, where they are used to determine compensation parameters. During the online phase, only the current LCU pixels and pre-determined parameters are used for compensation. This segmentation reduces device complexity and operational complexity during the critical online compensation phase while still utilizing adjacent LCU pixels for accurate parameter determination.
Data Source
AI summary
An image processing method and apparatus, the image processing method including receiving a first largest coding unit of an image, where the first largest coding unit is a currently received largest coding unit; determining a compensation parameter of the first largest coding unit; performing pixel compensation on at least one area of the first largest coding unit according to the compensation parameter of the first largest coding unit; and performing pixel compensation on at least one area, on which pixel compensation is not performed, of a second largest coding unit according to a compensation parameter of the second largest coding unit, where the second largest coding unit is a previously received largest coding unit adjacent to the first largest coding unit.