Stereo Camera Movement Measurement Without IMU

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional methods for calculating camera movement require additional devices like IMUs, making the system costly and difficult to reduce size.

Innovation Solution

A measuring device that uses stereo image acquisition and distance measurement units to calculate camera movement solely based on image data, eliminating the need for external devices by comparing distance images from different frames.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If additional devices such as IMU are used to calculate camera movement, then measurement accuracy is improved, but device complexity and cost increase

Engineering Contradiction:
Improvecamera movement measurement accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent extracts the movement measurement function from external devices (IMU) and implements it within the imaging apparatus itself using image data processing. The movement amount calculating unit derives camera movement solely from sequential stereo images, eliminating the need for separate motion sensing devices.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The imaging apparatus is designed to perform multiple functions: capturing stereo images for depth measurement and simultaneously calculating camera movement from the same image data. This multi-functional approach allows the system to obtain both distance information and movement information without adding separate dedicated devices.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Measurement precision

If additional devices such as IMU are used to calculate camera movement, then measurement accuracy is improved, but cost increases

Engineering Contradiction:
Improvecamera movement measurement accuracyVSAvoidmanufacturing cost
Core Design Contradiction:
Measurement precisionVSEase of manufacture

Solution Approach 1:

The patent removes the requirement for expensive external IMU devices and extracts the movement measurement capability into the imaging apparatus's processing unit. This eliminates the need to manufacture and integrate separate motion sensing hardware, thereby reducing overall system cost.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The system uses standard imaging sensors and processing algorithms that are already widely available and cost-effective, replacing expensive specialized motion measurement devices. The approach leverages existing, inexpensive image data to achieve movement measurement without requiring costly hardware.

Inventive Principle:
Principle #27Cheap short-living objects (Disposable)

3Measurement precision

If additional devices are added to the imaging apparatus, then measurement capability is improved, but device size increases

Engineering Contradiction:
Improvemovement measurement capabilityVSAvoidapparatus size
Core Design Contradiction:
Measurement precisionVSVolume of moving object

Solution Approach 1:

The imaging apparatus processes image data to achieve multiple measurement objectives: depth mapping through stereo vision and camera movement tracking through temporal comparison. This multi-functionality is achieved within the existing processing architecture without adding separate physical measurement devices.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent replaces mechanical motion sensing devices (IMU with accelerometers and gyroscopes) with an optical-digital system that calculates movement from image sequences. This substitution eliminates the need for mechanical sensors and their associated hardware, reducing device volume.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables accurate calculation of camera movement without external devices, reducing system size and cost while improving measurement accuracy.

Implementation Method 1

acquire a first distance image from the first image and the second image and acquire a second distance image from the third image and the fourth image

Methodology Applied
Scientific EffectParallax: Parallax

Data Source

PatentUS20230274444A1Measuring device, moving device, measuring method, and storage medium
Publication Date: 2023.08.31 CANON KK
  • US20230274444A1 patent drawing
  • US20230274444A1 patent drawing
  • US20230274444A1 patent drawing

AI summary

A measuring device including: a stereo image acquiring unit configured to acquire a first image of a first viewpoint and a second image of a second viewpoint at a predetermined first time and acquire a third image of the first viewpoint and a fourth image of the second viewpoint at a second time different from the first time; a stereo distance measuring unit configured to acquire a first distance image from the first image and the second image and acquire a second distance image from the third image and the fourth image; and a movement amount calculating unit configured to calculate a relative movement amount between the stereo image acquiring unit and a subject between the first time and the second time on the basis of the first distance image and the second distance image.