Image Processing Device Motion Vector Detection

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing image processing technologies face challenges in accurately detecting motion vectors and depth maps when images are captured under different shooting conditions, such as varying exposure times, leading to deteriorated detection accuracy.

Innovation Solution

An image processing device and method that combines difference information from images captured under different shooting conditions, using a combination of difference detection units and a combining unit to generate motion vectors and depth values, optimizing the use of short and long exposure images based on SN ratio, luminance, contrast, and motion amount.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If images with different exposure times are used to detect motion vectors, then the detection can be performed under varying shooting conditions, but the detection accuracy deteriorates when exposure time difference is small or large

Engineering Contradiction:

Improveadaptability to different shooting conditionsVSAvoidmotion vector detection accuracy

Core Design Contradiction:

Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The patent dynamically selects the optimal exposure time difference based on shooting conditions. The system adjusts the exposure time difference between first and second images according to luminance levels, contrast, and motion amount, rather than using a fixed exposure difference. This dynamic adaptation resolves the contradiction by optimizing accuracy for each specific shooting scenario while maintaining versatility across different conditions.

Inventive Principle:

Principle #15Dynamics

Solution Approach 2:

The patent changes the exposure time parameter dynamically based on shooting conditions. By adjusting the exposure time difference according to luminance, contrast, and motion amount, the system optimizes motion vector detection accuracy for each scenario. This parameter change approach allows the system to maintain high accuracy across varying shooting conditions without being constrained by fixed exposure settings.

Inventive Principle:

Principle #35Parameter changes

2Ease of manufacture

If block matching method is used to detect motion vectors, then the method is simple to implement, but the detection accuracy deteriorates when image difference is caused by factors other than motion

Engineering Contradiction:

Improveease of implementationVSAvoidmotion vector detection accuracy

Core Design Contradiction:

Ease of manufactureVSMeasurement precision

Solution Approach 1:

The patent extracts and removes the influence of exposure time differences from the image comparison process. By separating the exposure effect from the motion effect, the system can use block matching to detect motion vectors accurately even when images have different exposure times. This extraction approach maintains the simplicity of block matching while eliminating its main limitation regarding exposure differences.

Inventive Principle:

Principle #2Taking out (Extraction)

3Loss of information

If images with large exposure time difference are used, then the difference between images is more pronounced, but the accuracy of linear equation approximation deteriorates

Engineering Contradiction:

Improveimage difference visibilityVSAvoidlinear equation approximation accuracy

Core Design Contradiction:

Loss of informationVSMeasurement precision

Solution Approach 1:

The patent dynamically optimizes the exposure time difference based on shooting conditions rather than using a large fixed difference. By adjusting the exposure difference according to luminance, contrast, and motion amount, the system finds the optimal balance between image difference visibility and linear equation approximation accuracy for each scenario.

Inventive Principle:

Principle #15Dynamics

Solution Approach 2:

The patent uses partial exposure time difference rather than always using large differences. By applying just the right amount of exposure difference needed for each shooting condition, the system avoids the diminishing returns and accuracy deterioration that occur with excessively large exposure differences, while still maintaining sufficient image difference for reliable detection.

Inventive Principle:

Principle #16Partial or excessive action

Data Source

PatentUS10002436B2Image processing device, image processing method, and solid-state imaging device

Publication Date: 2018.06.19 SONY SEMICON SOLUTIONS CORP

AI summary

The present disclosure relates to an image processing device, an image processing method, and a solid-state imaging device capable of detecting image information with high accuracy by using images with different shooting conditions. A difference detection unit detects difference information of a short exposure image of a current frame and a past frame shot in a short exposure time. The difference detection unit detects difference information of a long exposure image of a current frame and a past frame shot in a long exposure time. The combining unit combines the difference information of the short exposure image and the difference information of the long exposure image on the basis of the short exposure image or the long exposure image and generates a motion vector of the current frame on the basis of the combined difference information. The present disclosure may be applied to the image processing apparatus and the like, for example.