Camera Azimuth Correction via Roll and Pitch Sensor Fusion

Solution Overview

Problem

Conventional digital cameras with electronic compasses do not correct the display azimuth according to changes in camera posture, leading to incorrect recording of image capturing azimuth, which results in an unnatural display mode and incorrect azimuth information for captured images.

Innovation Solution

An imaging device equipped with a geomagnetic sensor and an acceleration sensor that calculates the rotation angles in roll and pitch directions, allowing for the detection of the image capturing direction's orientation relative to the vertical plane, and adjusts the azimuth calculation and display accordingly to maintain a natural compass image orientation and record accurate image capturing azimuth.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If the display azimuth is corrected according to camera posture changes to display compass image in natural orientation, then the compass image display becomes natural for user, but the recorded image capturing azimuth becomes incorrect

Engineering Contradiction:

Improvecompass image display naturalnessVSAvoidimage capturing azimuth accuracy

Core Design Contradiction:

Ease of operationVSMeasurement precision

Solution Approach 1:

The patent segments the azimuth information into two distinct types: display azimuth (corrected for natural compass image display) and image capturing azimuth (uncorrected for accurate recording). This segmentation allows the system to provide different azimuth values for different purposes, resolving the contradiction between natural display and accurate recording.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent introduces an intermediary mechanism that calculates both display azimuth and image capturing azimuth separately. The display azimuth is derived by correcting the image capturing azimuth according to camera posture (roll, pitch, yaw angles), while the image capturing azimuth is recorded directly without correction. This intermediary calculation process enables both natural display and accurate recording simultaneously.

Inventive Principle:

Principle #24Intermediary (Mediator)

2Measurement precision

If the display azimuth is not corrected according to camera posture changes, then the recorded image capturing azimuth remains accurate, but the compass image display becomes unnatural for user

Engineering Contradiction:

Improveimage capturing azimuth accuracyVSAvoidcompass image display naturalness

Core Design Contradiction:

Measurement precisionVSEase of operation

Solution Approach 1:

The patent segments the azimuth information into two distinct types: display azimuth (corrected for natural compass image display) and image capturing azimuth (uncorrected for accurate recording). This segmentation allows the system to provide different azimuth values for different purposes, resolving the contradiction between natural display and accurate recording.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent introduces an intermediary mechanism that calculates both display azimuth and image capturing azimuth separately. The display azimuth is derived by correcting the image capturing azimuth according to camera posture (roll, pitch, yaw angles), while the image capturing azimuth is recorded directly without correction. This intermediary calculation process enables both natural display and accurate recording simultaneously.

Inventive Principle:

Principle #24Intermediary (Mediator)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables the display of a compass image in a natural orientation for the user and records the correct image capturing azimuth, even when the camera posture changes, ensuring accurate azimuth information is associated with captured images.

Implementation Method 1

a geomagnetic sensor that detects geomagnetism information

Methodology Applied

Scientific EffectGeomagnetism detection: Magnetic Field

Implementation Method 2

an acceleration sensor that detects acceleration information

Methodology Applied

Scientific EffectAcceleration detection: Accelerometer

Data Source

PatentEP2518993B1Image capturing device, azimuth information processing method, and program

Publication Date: 2017.08.02 SONY GROUP CORP

Figure 1
Figure 2
Figure 3

AI summary

Even when a posture of an imaging device changes, the imaging device can display a compass image in a natural mode when seen from a user's viewpoint and record a correct image capturing azimuth. Provided is an imaging device including: an image capturing unit which captures an image of a subject and outputs the captured image; an azimuth calculating unit which calculates an azimuth of the image capturing unit in an image capturing direction, based on geomagnetism information detected by a geomagnetic sensor and acceleration information detected by an acceleration sensor; an azimuth converting unit which calculates a rotation angle of the imaging device in a roll direction, based on the acceleration information, and converts the azimuth in the image capturing direction into a display azimuth based on the rotation angle in the roll direction; a display unit which displays a compass image representing the display azimuth and the captured image; and a recording unit which associates azimuth information representing the azimuth in the image capturing direction, with the captured image to record in a recording medium.