Sample Adaptive Offset Skipping for Faster Video Coding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video coding technologies, particularly sample adaptive compensation, face high computational loads and inefficiencies on mobile devices, leading to video frame loss, stuttering, and unnecessary power consumption due to rough determination conditions for overall skipping and mode simplification strategies that do not consider content features.
Innovation Solution
A method that combines coding frame type, sub-block type, and adjacent coding tree unit information to determine whether to skip sample compensation, and if not skipped, simplifies compensation modes based on video scene and sub-block type, reducing the number of compensation modes to be traversed.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If sample adaptive compensation is performed on all coding tree units, then compensation precision is improved, but calculation overhead increases significantly
Solution Approach 1:
The patent segments the set of all coding tree units into multiple categories based on frame type (intra-frame, inter-frame, skip blocks, etc.). Different segmentation strategies are applied to different unit types, allowing the system to perform detailed compensation only on units that require it while skipping others, thus resolving the contradiction between precision and computational complexity.
Solution Approach 2:
The patent applies different compensation strategies to different local regions (coding tree units) based on their specific characteristics. Instead of uniform processing, each unit is evaluated and processed according to its own needs, achieving high precision where necessary while reducing overall calculation overhead through localized optimization.
2Speed
If determination conditions for overall skipping are made rougher, then processing speed is improved, but acceleration effect on small blocks deteriorates
Solution Approach 1:
The patent implements dynamic determination conditions for skipping sample adaptive compensation based on the size and type of coding tree units. The skipping criteria are not fixed but adapt dynamically to the specific characteristics of each unit, allowing aggressive skipping for large blocks while maintaining careful evaluation for small blocks, thus achieving both high processing speed and effective acceleration.
3Device complexity
If mode simplification is applied without considering content features, then calculation overhead is reduced, but compensation precision is lost
Solution Approach 1:
The patent applies mode simplification selectively based on content features of coding frames. Instead of uniform simplification, the system evaluates content characteristics and applies appropriate simplification levels locally, maintaining high compensation precision for complex content while reducing calculation overhead for simpler content areas.
4Measurement precision
If sample adaptive compensation is performed on mobile devices, then compensation precision is improved, but power consumption and heat generation increase
Solution Approach 1:
The patent segments mobile device processing into priority levels and categories of coding tree units. By identifying and processing only the most critical units with full compensation while using simplified or skipped processing for others, the system maintains acceptable compensation precision for important content while significantly reducing power consumption on mobile devices.
Data Source
Figure 1
Figure 2~3
Figure 4~5
AI summary
The present application provides a sample adaptive offset method, apparatus and device, a storage medium, and a product. The method comprises: acquiring coding reference information of a coding tree unit and a corresponding video scene; according to a coding frame type and offset mode information, determining whether to skip sample offset of the coding tree unit; in response to a determination result of skipping the sample offset, skipping the sample offset of the coding tree unit; in response to a determination result of not skipping the sample offset, determining, according to a coding sub-block type and the video scene, offset modes to be traversed; and performing sample offset processing on the coding tree unit on the basis of the offset modes to be traversed. According to the present application, whether the offset can be skipped or not is preliminarily determined on the basis of the coding frame type and the offset mode information, to achieve the preliminary acceleration effect; the offset mode is simplified from the perspectives of internal coding information of the coding tree unit and content features, so that under the condition of slightly sacrificing the offset accuracy, the calculation overhead is saved, and the offset processing speed is efficiently improved.