Image Processing Apparatus Motion Vector Detection Panning Assist

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image processing techniques for panning photography face challenges in accurately detecting motion vectors due to differences in subject movement speed and panning speed, particularly when the sampling interval of continuously photographed images increases, leading to insufficient real-time processing and reduced detection accuracy.

Innovation Solution

An image processing apparatus that includes an acquisition unit for capturing first and second images, a determination unit for selecting images based on photometry results, and a calculation unit for calculating motion vectors, utilizing high-resolution images and prioritizing either resolution or sampling rate to enhance motion vector detection accuracy during panning assist modes.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If the sampling interval of continuously photographed images is increased, then the processing time for motion vector detection is reduced, but the detection accuracy deteriorates

Engineering Contradiction:
Improveprocessing speedVSAvoidmotion vector detection accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The patent applies preliminary action by performing photometry in advance on captured images to evaluate their quality before motion vector detection. This allows the system to pre-select suitable images based on exposure and quality metrics, ensuring that only high-quality images are used for detection, thereby maintaining accuracy while optimizing processing efficiency.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent implements dynamics by adaptively selecting images for motion vector detection based on photometry results. The system dynamically adjusts which images are used for detection according to their quality assessment, rather than using a fixed sampling interval. This dynamic selection ensures optimal balance between processing speed and detection accuracy varying with scene conditions.

Inventive Principle:
Principle #15Dynamics

2Measurement precision

If the comparison area between reference block and candidate block is enlarged, then the detection accuracy is improved, but the processing time is prolonged

Engineering Contradiction:
Improvemotion vector detection accuracyVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent applies local quality by performing photometry on specific regions of interest within images rather than processing entire images uniformly. By evaluating image quality locally and selecting regions with better quality for motion vector detection, the system improves detection accuracy in critical areas while reducing overall processing time by excluding poor-quality regions.

Inventive Principle:
Principle #3Local quality

3Measurement precision

If high-resolution images are used for motion vector detection, then the detection accuracy is improved, but the processing load increases

Engineering Contradiction:
Improvemotion vector detection accuracyVSAvoidprocessing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent extracts essential quality information through photometry measurements taken from captured images before full motion vector detection. By extracting and evaluating key quality metrics (exposure, brightness) in advance, the system can select appropriate images for detection without processing all high-resolution images, thereby reducing processing complexity while maintaining detection accuracy using only suitable high-resolution images.

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentUS10594938B2Image processing apparatus, imaging apparatus, and method for controlling image processing apparatus
Publication Date: 2020.03.17 CANON KK
  • US10594938B2 patent drawing
  • US10594938B2 patent drawing
  • US10594938B2 patent drawing

AI summary

An accelerated processing unit (APU) serving as an image processing apparatus includes an acquisition unit configured to acquire a first image captured through first imaging and a second image captured through second imaging performed subsequent to the first imaging; a first determination unit configured to determine an image used for calculating a motion vector from the first image and/or the second image in accordance with a result of photometry based on the first image; and a calculation unit configured to calculate the motion vector on the basis of the determined image.