Variance Estimation via Motion Vectors in Video Processing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Determining variance for pixel blocks in images and videos is computationally intensive, leading to slow analysis processes in image and video processing applications.
Innovation Solution
The technique involves using motion vectors to estimate variance for pixel blocks in a current frame based on the variance of corresponding blocks in a reference frame, with thresholds and correlation functions to determine when direct variance calculation is necessary, thereby reducing computational load.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If direct variance calculation is performed for each pixel block, then measurement precision is improved, but computational load increases and processing speed decreases
Solution Approach 1:
The patent uses motion vectors to copy variance information from reference frame blocks to current frame blocks. Instead of recalculating variance for each block in the current frame, the system retrieves pre-computed variance values from the reference frame using motion vector data, thereby maintaining measurement precision while significantly reducing computational load and improving processing speed.
Solution Approach 2:
The patent performs preliminary variance calculation only for the reference frame rather than for every frame. By pre-computing variance values for the reference frame and then reusing them through motion vector mapping, the system avoids redundant calculations in subsequent frames, thereby reducing overall computational complexity while maintaining accurate variance determination.
2Measurement precision
If variance is determined for all pixel blocks, then measurement precision is improved, but computational load increases
Solution Approach 1:
The patent leverages motion vectors to copy variance information from the reference frame to the current frame. This allows the system to determine variance for all pixel blocks in the current frame without performing actual variance calculations, instead retrieving pre-computed values through spatial mapping, thereby maintaining measurement precision while significantly reducing computational energy consumption.
Solution Approach 2:
The patent enables the system to serve its own variance determination needs by reusing previously computed variance data from the reference frame. Through motion vector-based mapping, the system makes the reference frame variance data serve the current frame's variance determination requirements, eliminating redundant computations and reducing overall energy consumption.
Data Source
AI summary
Techniques are provided for determining variance of a pixel block in a frame of video based on variance of pixel blocks in a reference frame of the video, instead of directly, for example, by calculating variance based on pixel values of the pixel block. The techniques include identifying a motion vector for a pixel block in a current frame, the motion vector pointing to a pixel block in a reference frame. The techniques also include determining the cost associated with the motion vector and comparing the cost to first and second thresholds. The techniques include determining the variance for the pixel block of the current frame based on the comparison of the cost to the first and second threshold and based on the variance of the pixel block of the reference frame.