Time-division stereo image correction using motion vector interpolation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Time-division stereo image pickup apparatuses face motion shifts due to image pickup time differences, which can lead to incorrect stereo measurements, especially when subjects are moving or the apparatus is shaken, as existing correction methods using motion vectors fail to accurately account for variations in subject distance.
Innovation Solution
An image pickup apparatus with a first and second optical system, a switcher, and a processor that calculates motion vectors in divided regions of base images, interpolates interpolation motion vectors based on brightness or contrast values, and corrects images to form prediction images that precede or follow the original images, ensuring accurate stereo measurement by synchronizing image pickup times.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If time-division stereo image pickup is used to reduce device complexity, then the apparatus structure is simplified, but motion shifts occur due to image pickup time differences
Solution Approach 1:
The patent applies preliminary action by generating prediction images that temporally precede or follow the original images using motion vectors before performing stereo measurement. This pre-processing step compensates for motion shifts caused by time-division pickup, ensuring that the images used for stereo measurement are temporally aligned and free from motion-induced errors.
2Reliability
If motion vector correction is applied to suppress motion shifts, then stereo measurement accuracy is improved, but measurement precision deteriorates when subjects have large variations in subject distance
Solution Approach 1:
The patent applies local quality by dividing the image into multiple regions and calculating separate motion vectors for each region. This allows the correction to adapt to local variations in subject distance and motion characteristics, improving measurement precision for subjects with large depth variations while maintaining overall stereo measurement accuracy.
Solution Approach 2:
The patent segments the image into multiple regions and processes each region independently with its own motion vector calculation. This segmentation enables precise handling of different depth zones, allowing accurate stereo measurement even when subjects have large variations in subject distance, as each region's motion is corrected according to its specific characteristics.
3Reliability
If image correction to prediction images is performed to eliminate motion shifts, then stereo measurement reliability is improved, but processing time increases
Solution Approach 1:
The patent applies partial action by performing motion vector calculation and image correction only on necessary regions or using simplified correction methods where full correction is not required. This reduces processing time while maintaining sufficient stereo measurement reliability, balancing the trade-off between correction thoroughness and processing efficiency.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The solution effectively suppresses motion shifts caused by image pickup time differences, enabling accurate stereo measurement even with subjects having large variations in subject distance, by generating prediction images that align with the original images, thus improving the reliability of stereo imaging.
Implementation Method 1
a first optical system (21) configured to transmit light through a first optical path (L1); a second optical system (22) configured to transmit light through a second optical path (L2), the second optical system (22) having parallax with the first optical system (21)
Data Source
AI summary
An image pickup apparatus has a first/second optical system transmitting light through a first/second optical path, the second optical system having parallax with the first optical path; a switcher switching between the first and second optical paths in time series; an image sensor forming a first image and a second image by capturing subject images according to the light transmitted through the first optical path and the second optical path respectively; and a processor processing a signal output from the image sensor, wherein the processor calculates a motion vector in each divided region of a first base image from the first base image and a first reference image captured, interpolates an interpolation motion vector for each pixel of the first base image from the motion vector, and corrects the first base image or the first reference image to form a prediction image of the first image.