Video Encoder Background Detection Using Temporal Block Comparison
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Modern video encoders, particularly those using the HEVC standard, face increased complexity and computational resource requirements due to larger transform sizes, which complicates background detection and affects coding efficiency.
Innovation Solution
The techniques involve a video encoder that compares video blocks to corresponding blocks in previous frames to determine background content, allowing for adaptive adjustment of background detection thresholds and reducing the complexity of mode decision and motion estimation processes.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If larger transform sizes (16×16 and 32×32) are used in HEVC standard, then coding efficiency is improved, but device complexity and computational resource requirements increase
Solution Approach 1:
The video frame is divided into multiple blocks, and each block is independently analyzed for background content using separate mode decision and motion estimation units. This segmentation allows parallel processing of different blocks, reducing the overall computational burden while maintaining the benefits of larger transform sizes for each block.
Solution Approach 2:
Background detection is performed as a preliminary step before full motion estimation and mode decision processes. By identifying background blocks in advance, the system can apply simplified encoding processes to these blocks, reducing computational resources required for the subsequent detailed processing steps.
2Productivity
If background detection is performed on all video blocks, then coding efficiency is improved, but computational resource requirements increase
Solution Approach 1:
Different processing approaches are applied to different regions of the video frame based on their content characteristics. Background blocks identified through detection receive simplified processing, while foreground blocks undergo full processing. This local differentiation optimizes the balance between coding efficiency and computational resource usage.
Solution Approach 2:
The complexity of processing is dynamically adjusted based on the detected content type. For background blocks, parameters such as motion estimation search range and mode decision options are reduced, while foreground blocks maintain full parameter sets. This adaptive parameter adjustment reduces overall computational resources while preserving coding efficiency.
3Reliability
If full motion estimation is applied to all blocks, then video quality is maintained, but processing time increases
Solution Approach 1:
The motion estimation process is made dynamic by adjusting its complexity based on block classification. Background blocks use simplified motion estimation with reduced search ranges and fewer candidate motions, while foreground blocks undergo complete motion estimation. This dynamic adaptation maintains video quality for important content while reducing processing time overall.
Solution Approach 2:
Full motion estimation is applied only to foreground blocks where it is necessary for maintaining video quality, while background blocks receive partial motion estimation. This selective application of the full processing sequence reduces overall processing time while maintaining quality where it matters most.
Data Source
AI summary
Systems and methods for low complexity encoding and background detection are described herein. One aspect of the subject matter described in the disclosure provides a video encoder comprising a memory configured to store a video block. The video encoder further comprises a processor in communication with the memory. The processor is configured to determine whether the video block is background by comparing the video block to a corresponding block located in a previous temporal frame. The processor is further configured to determine, when the video block is not background, whether one or more sub-blocks of the video block are background by comparing the sub-blocks to corresponding sub-blocks located in the previous temporal frame.