Sub-Pixel Motion Vector Detection On-The-Fly Calculation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional video compression methods require excessive processor and memory resources due to multiple memory read/write cycles and unnecessary calculations, leading to increased processor consumption and memory demands without significant improvements in sub-pixel motion vector detection.
Innovation Solution
Implementing an on-the-fly calculation of interpolated sub-pixel positions using bilinear averaging, which reduces redundant calculations and intermediate storage, allowing for dynamic sub-pixel estimation with a predetermined accuracy threshold, thereby minimizing processing and memory requirements.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If conventional video compression methods use multiple memory read/write cycles and intermediate storage for sub-pixel interpolation, then sub-pixel motion vector detection accuracy is improved, but processor consumption and memory demands increase significantly
Solution Approach 1:
The patent extracts and eliminates unnecessary intermediate storage and memory read/write cycles from the conventional sub-pixel interpolation process. By using on-the-fly bilinear averaging calculations that perform interpolation directly without storing intermediate results, the method removes the harmful element (excessive memory usage) while preserving the essential function (sub-pixel motion detection accuracy).
Solution Approach 2:
The patent uses a simplified copying approach where instead of storing multiple intermediate interpolation results in memory, it calculates and uses only the necessary interpolated values immediately. This reduces memory demands while maintaining the functional equivalent of conventional interpolation methods.
2Measurement precision
If conventional video compression methods perform multiple memory read/write cycles for sub-pixel interpolation, then motion estimation accuracy is improved, but device complexity increases
Solution Approach 1:
The patent removes the complex intermediate storage and multiple memory access cycles from the motion estimation process. By implementing on-the-fly bilinear averaging that calculates interpolated values directly during the estimation process rather than requiring separate storage and retrieval operations, the method simplifies the device complexity while maintaining motion estimation accuracy.
Solution Approach 2:
The patent performs the bilinear averaging calculation in advance during the motion estimation process itself, rather than requiring subsequent memory read/write operations. This preliminary calculation of interpolated values integrates the complex operation into a single streamlined step, reducing overall device complexity.
3Measurement precision
If conventional methods calculate and store all interpolated sub-pixel positions for later use, then sub-pixel plane motion vector detection is improved, but processing time increases due to redundant calculations
Solution Approach 1:
The patent extracts and removes the redundant step of calculating and storing all interpolated sub-pixel positions in advance. Instead, it performs bilinear averaging on-demand during the motion vector search process, eliminating the time loss associated with preparing and retrieving intermediate results while maintaining detection precision.
Solution Approach 2:
The patent transitions from a static approach where all interpolated values are pre-calculated and stored, to a dynamic on-the-fly calculation approach. This dynamic method calculates only the necessary interpolated values at the moment they are needed during motion estimation, reducing processing time while preserving accuracy.
Data Source
AI summary
A video processing system, method and computer program storage device cooperate to provide a resource and performance efficient sub-pixel motion search operation. Using on the fly calculations it is possible to provide approximations of sub-pixel positions on one image with respect to another image in an image sequence. A sub-pixel position used to set a motion vector for an encoding process may then be identified with reduced processing and memory resources relative to conventional techniques. Also, by later performing a full encoding cost analysis on the earlier identified sub-pixel position, and keeping track of differences, an interpolation accuracy may be dynamically improved by applying the differences to subsequent image frames.