Block-Based Temporal Smoothing for Video Noise Reduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Immersive videos often exhibit temporal noise, particularly in static backgrounds, which can be distracting for viewers and negatively impact viewer perceptual quality, and existing technologies have not effectively addressed this issue during video encoding and transmission.
Innovation Solution
The implementation of block-based temporal smoothing techniques, which decompose video frames into 2-D blocks and apply recursive partitioning and filtering to identify and remove temporal noise based on error metrics, improving video denoising and compression efficiency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If block-based temporal smoothing is applied to remove temporal noise, then video perceptual quality is improved, but encoding complexity increases
Solution Approach 1:
The video frame is divided into multiple blocks, and temporal smoothing is applied selectively to each block based on its motion characteristics. This segmentation allows the encoding process to focus computational resources only on blocks that require smoothing, rather than processing the entire frame uniformly, thus reducing overall encoding complexity while maintaining perceptual quality.
Solution Approach 2:
The patent applies temporal smoothing selectively only to blocks that exhibit specific characteristics (e.g., low motion, high noise), rather than applying it to all blocks. This partial action approach reduces the computational burden compared to full-frame smoothing while still achieving the desired perceptual quality improvement in the regions that need it most.
2Manufacturing precision
If temporal smoothing filtering is applied to reduce temporal noise, then video perceptual quality is improved, but transmission bandwidth increases
Solution Approach 1:
The patent applies different processing treatments to different regions of the video frame based on local characteristics. Blocks with high motion or low noise content are processed differently from blocks with low motion and high noise content. This local quality approach ensures that bandwidth is consumed only where necessary for perceptual quality improvement, rather than uniformly across the entire frame.
Solution Approach 2:
The patent modifies encoding parameters dynamically based on block characteristics, such as adjusting the smoothing strength or filtering intensity for different blocks. By changing these parameters locally rather than globally, the system achieves perceptual quality improvement while minimizing the increase in transmission bandwidth.
Data Source
AI summary
Aspects of the disclosure provide methods and apparatuses for video processing. In some examples, an apparatus for video processing includes processing circuitry. For example, processing circuitry determines a frame interval for a current block in a current frame within a sequence of frames. The frame interval indicates a group of frames in the sequence of frames with collocated blocks of the current block that satisfy an error metric requirement comparing to the current block. Further, the processing circuitry determines a replacement block based on the collocated blocks in the group of frames, and replaces the current block in the current frame with the replacement block.