Image Stabilization Using Sensor-Driven Feature Point Distance

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Image authenticity judgment is inaccurate due to image distortion caused by camera shake or blur when acquiring images of posted notices and their surroundings.

Innovation Solution

An electronic device equipped with sensors (gyro, acceleration, and orientation sensors) and an image acquisition unit determines feature points in a reference image, calculates feature-point distances, and judges the device's movement stability to store a high-quality image only when movement is within predetermined limits.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If image acquisition is performed during device movement, then productivity is improved, but image quality deteriorates due to camera shake and distortion

Engineering Contradiction:
Improveimage acquisition speedVSAvoidimage quality
Core Design Contradiction:
ProductivityVSManufacturing precision

Solution Approach 1:

The patent converts the harmful effect of device movement into a useful indicator by using sensor data to detect motion states. Instead of preventing movement entirely, the system utilizes acceleration and gyro sensors to measure movement, then applies correction algorithms to compensate for the detected motion, transforming the previously harmful camera shake into actionable information for image stabilization.

Inventive Principle:
Principle #22Blessing in disguise (Convert harm into benefit)

Solution Approach 2:

The system dynamically adjusts image processing parameters based on detected movement conditions. When motion is detected through sensor data, the system modifies processing timing, applies stabilization algorithms, and adjusts feature point matching parameters to account for the movement, thereby maintaining image quality despite continued device motion during acquisition.

Inventive Principle:
Principle #35Parameter changes

2Manufacturing precision

If image processing is performed to correct distortion, then image quality is improved, but computational complexity increases

Engineering Contradiction:
Improveimage qualityVSAvoidprocessing complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The system performs preliminary stabilization by capturing multiple images at different timings and selecting or combining them based on sensor-detected movement conditions. Feature point positions are predicted based on motion data before final image processing, pre-compensating for expected distortion and reducing the complexity of subsequent correction operations.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces sensor data as an intermediary element between the moving device and the image processing pipeline. Acceleration and gyro sensor readings serve as intermediate measurements that inform the processing algorithm about device motion, enabling targeted corrections without requiring complex analysis of the distorted image itself.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Manufacturing precision

If multiple images are acquired to ensure quality, then image quality is improved, but time consumption increases

Engineering Contradiction:
Improveimage qualityVSAvoidacquisition time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The system employs periodic image acquisition at specifically timed intervals based on sensor data analysis. Instead of continuous shooting, images are captured at periodic moments when sensor indicators suggest stable conditions or when motion patterns predict optimal capture timing, reducing total acquisition time while maintaining quality through selective sampling.

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The patent applies partial action by acquiring fewer images than traditional methods would require, compensating for reduced quantity through intelligent selection based on sensor feedback. The system captures images selectively during favorable motion conditions detected by sensors, achieving adequate quality with less total acquisition time by focusing resources on the most promising capture moments.

Inventive Principle:
Principle #16Partial or excessive action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This method stabilizes the electronic device for acquiring target-object images, preventing image distortion and enhancing authenticity judgment reliability.

Implementation Method 1

an image acquisition method executed by an electronic device including at least one sensor from among a gyro sensor, an acceleration sensor, and an orientation sensor

Methodology Applied
Scientific EffectGyro sensor detection: Gyroscope

Implementation Method 2

an image acquisition method executed by an electronic device including at least one sensor from among a gyro sensor, an acceleration sensor, and an orientation sensor

Methodology Applied
Scientific EffectAcceleration sensor detection: Accelerometer

Implementation Method 3

a step of repeatedly obtaining an image of the space by means of the image acquisition unit

Methodology Applied
Scientific EffectLight reflection and detection: Reflection

Data Source

PatentUS11877060B2Method, program, and electronic device for stabilization of image acquisition using known image
Publication Date: 2024.01.16 CYGAMES INC
  • US11877060B2 patent drawing
  • US11877060B2 patent drawing
  • US11877060B2 patent drawing

AI summary

Provided is an electronic device including: a sensor; an image acquisition unit; a storage unit that stores a reference image that is an image of a target object; a feature-point position determining unit that determines the positions of feature points indicating local feature quantities in the reference image; a feature-point distance calculating unit that repeatedly executes detection of points corresponding to the feature points in the reference image from the acquired image of the space and calculation of the distances with respect to the positions of the detected points; a judgment unit that judges whether the amount of movement is equal to or less than a predetermined allowable reference value; and a control unit that obtains the acquired image of the space and stores the image of the space if it is judged that the amount of movement is equal to or less than the allowable reference value.