Behavior-Based Shake Correction for Moving-Object Imaging

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing imaging devices perform image shake correction on stationary parts of a captured image, leading to unnatural movement, and fail to correct shaking due to a moving object's behavior.

Innovation Solution

Determine if a captured image includes a scene outside a moving object and perform shake correction processing based on the object's behavior data to cancel shaking.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If image shake correction is performed on the entire captured image, then shaking of the captured image is corrected, but the stationary part moves unnaturally

Engineering Contradiction:

Improveimage shake correction effectivenessVSAvoidunnatural movement of stationary part

Core Design Contradiction:

ReliabilityVSObject-generated harmful factors

Solution Approach 1:

The patent divides the captured image into multiple regions: a first region containing the moving object and a second region containing the stationary scene. Different image processing is applied to each region - the moving object region is not corrected while the stationary scene region undergoes shake correction. This segmentation approach resolves the contradiction by preventing correction of the moving object (avoiding unnatural movement) while still correcting the stationary scene (maintaining correction effectiveness).

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent applies different correction characteristics to different regions of the image. The stationary scene region receives full shake correction processing, while the moving object region receives no correction or different correction processing. This local differentiation allows the system to maintain correction effectiveness in appropriate regions while avoiding harmful effects in other regions.

Inventive Principle:

Principle #3Local quality

2Object-generated harmful factors

If image shake correction is not performed on the captured image, then the stationary part remains natural, but shaking due to moving object behavior is not corrected

Engineering Contradiction:

Improvenatural appearance of stationary partVSAvoidshake correction effectiveness

Core Design Contradiction:

Object-generated harmful factorsVSReliability

Solution Approach 1:

By segmenting the image into moving object region and stationary scene region, the system can selectively apply shake correction only to the stationary scene region while leaving the moving object region unchanged. This resolves the contradiction by maintaining natural appearance of the stationary part through targeted correction while still providing shake correction effectiveness where needed.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent implements local quality differentiation by applying shake correction processing selectively to the stationary scene region while excluding the moving object region. This allows the system to maintain natural appearance in the stationary region while providing necessary correction in the stationary scene, resolving the contradiction between natural appearance and correction effectiveness.

Inventive Principle:

Principle #3Local quality

3Reliability

If shake correction processing is applied to the captured image, then shaking is corrected, but processing time is increased

Engineering Contradiction:

Improveshake correction effectivenessVSAvoidprocessing time

Core Design Contradiction:

ReliabilityVSLoss of time

Solution Approach 1:

The patent segments the image into two regions and applies shake correction processing only to the stationary scene region (first region) while skipping processing for the moving object region (second region). This selective processing reduces the overall processing time compared to correcting the entire image, while still maintaining correction effectiveness for the stationary scene portions.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

Instead of applying full shake correction to the entire image (excessive action), the patent applies correction only to the stationary scene region (partial action). This partial approach reduces processing time while maintaining sufficient correction effectiveness for the portions of the image that actually require correction.

Inventive Principle:

Principle #16Partial or excessive action

Data Source

PatentUS12556817B2Image processing device and image processing method

Publication Date: 2026.02.17 NISSAN MOTOR CO LTD

AI summary

An image processing device is disclosed that includes an image acquisition unit configured to acquire a captured image captured by an imaging device fixed to a moving object; a behavior data acquisition unit configured to acquire behavior data indicating behavior of the moving object when moving; a determination unit configured to determine whether or not the captured image includes scenery outside the moving object; and an image processing unit configured to, when the captured image is determined to include the scenery outside the moving object, perform shake correction processing on the captured image based on the behavior data acquired by the behavior data acquisition unit so as to cancel the shaking of the captured image due to the behavior.