Dynamic Search Range Motion Vector Calculation for Camera Shake
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image processing apparatuses face challenges in generating reliable motion vectors and appropriate interpolation frames when a digital video camera moves due to camera shake or panning during movie capturing, leading to suboptimal interpolation frame generation.
Innovation Solution
An image processing apparatus that calculates motion vectors by performing matching operations between contiguous frames within dynamically determined search ranges based on the camera's motion magnitude, allowing for the generation of more accurate interpolation frames even when the camera is in motion.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If a fixed search range is used for motion vector calculation, then the processing speed is maintained, but the reliability of motion vector calculation deteriorates when camera moves
Solution Approach 1:
The search range is made dynamic by adjusting it according to the detected camera motion magnitude. When camera motion is detected, the search range is expanded to accommodate larger displacement, while maintaining a smaller search range when camera is stationary. This dynamic adjustment resolves the contradiction between reliability and complexity.
Solution Approach 2:
The search range parameter is changed based on camera motion detection. The system modifies the search range size as a variable parameter rather than using a fixed value, allowing the parameter to adapt to different shooting conditions and maintain calculation reliability across varying camera movements.
2Reliability
If the search range is expanded to account for camera motion, then the reliability of motion vector calculation is improved, but the processing time increases
Solution Approach 1:
The search range is dynamically adjusted based on camera motion detection, expanding only when necessary and maintaining smaller range when camera is stationary. This dynamic approach balances processing time and reliability by avoiding unnecessary expansions.
Solution Approach 2:
Camera motion detection is performed in advance before motion vector calculation to determine the appropriate search range. This preliminary action allows the system to prepare the optimal search parameters beforehand, reducing processing time during the actual calculation phase.
3Productivity
If the search range is reduced for faster processing, then the processing speed is improved, but the ability to handle camera motion deteriorates
Solution Approach 1:
The search range dynamically adapts to camera motion conditions, using smaller ranges for stationary camera work to maximize processing speed and larger ranges when camera motion is detected to maintain adaptability. This resolves the contradiction between productivity and adaptability.
Data Source
AI summary
An image processing section includes: a motion vector calculation section for receiving information representing the magnitude of motion of an image capturing section and calculating a motion vector by performing a matching operation between first and second frames within a search range determined based on the magnitude of motion (a first search range and a second search range different from the first search range); and an interpolation frame generating section for generating an interpolation frame in accordance with the motion vector calculation result.