Stereo Camera Optical Axis Alignment for Telephoto Subject Tracking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing stereo camera systems struggle to capture wide angle and telephoto images simultaneously as stereo images, leading to issues with subject positioning and distance information calculation, particularly when the optical axes of the wide angle and telephoto lenses do not match, resulting in inaccurate focus adjustment and loss of subject tracking.

Innovation Solution

A stereo camera system with two imaging units, each equipped with a wide angle and telephoto optical system having matching optical axes, a pan and tilt mechanism, and directivity sensors for pupil division, allowing for simultaneous acquisition of stereo wide angle and telephoto images, enabling accurate subject positioning and distance calculation using parallax analysis.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If a panhead device with two compound-eye camera units (wide angle lens camera and zoom camera) is used to capture stereo wide angle images and stereo telephoto images simultaneously, then the capability to capture both wide angle and telephoto stereo images is improved, but the device size increases

Engineering Contradiction:
Improvecapability to capture wide angle and telephoto stereo imagesVSAvoiddevice size
Core Design Contradiction:
Adaptability or versatilityVSVolume of moving object

Solution Approach 1:

The patent combines wide angle and telephoto optical systems within a single imaging unit, sharing common components such as the image sensor and optical path where possible. This merging approach allows simultaneous capture of wide angle and telephoto images without requiring completely separate camera systems, thereby reducing overall device size while maintaining stereo imaging capability.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The imaging unit is designed to perform multiple functions - capturing both wide angle and telephoto images using the same physical infrastructure (mounting structure, sensor platform). The optical system can switch between or simultaneously capture different focal lengths, making a single unit serve multiple purposes that previously required separate dedicated cameras.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Device complexity

If the optical axes of wide angle lens camera and zoom camera are directed in the same direction but remain parallel without matching, then the structure is simplified, but the subject positioning accuracy deteriorates causing the main subject to be out of angle of view at high magnification

Engineering Contradiction:
Improveoptical axis alignment structureVSAvoidsubject positioning accuracy
Core Design Contradiction:
Device complexityVSManufacturing precision

Solution Approach 1:

The optical system incorporates adjustable optical axes that can dynamically align with the main subject. Rather than fixed parallel optical axes, the system allows the wide angle and telephoto optical systems to independently adjust their pointing directions, ensuring that both optical axes can match the main subject's position. This dynamic adjustment capability maintains subject positioning accuracy across different magnification levels.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent implements different optical axis characteristics for different optical systems - the wide angle optical system has a broader field of view while the telephoto optical system provides higher magnification. Each optical system's optical axis is optimized for its specific function, with the ability to independently adjust orientation. This local optimization allows each system to perform its specialized function effectively while maintaining overall system coordination.

Inventive Principle:
Principle #3Local quality

3Measurement precision

If the optical axes of wide angle optical system and telephoto optical system are made to match, then the subject tracking accuracy is improved, but the device complexity increases

Engineering Contradiction:
Improvesubject tracking accuracyVSAvoidoptical system alignment mechanism
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The imaging unit is designed to self-align its optical axes through integrated control mechanisms. The system automatically adjusts the optical axes of both wide angle and telephoto systems to match the main subject's position using feedback from image processing and coordinate transformation algorithms. This self-service alignment reduces the need for complex external alignment mechanisms and manual calibration procedures.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces complex mechanical alignment mechanisms with computational methods for achieving optical axis matching. Instead of using intricate mechanical linkages to physically align the optical axes, the system uses coordinate transformation algorithms and image processing to calculate and achieve alignment virtually. This substitution of mechanical complexity with computational intelligence maintains precision while simplifying the physical structure.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

4Adaptability or versatility

If two separate compound-eye camera units are used to capture stereo images, then the stereo image capture capability is improved, but the loss of information increases due to subject positioning deviation

Engineering Contradiction:
Improvestereo image capture capabilityVSAvoidsubject positioning information
Core Design Contradiction:
Adaptability or versatilityVSLoss of information

Solution Approach 1:

By merging the wide angle and telephoto imaging functions into a single integrated imaging unit with shared sensor platform and coordinated optical systems, the patent eliminates the information loss that occurs when separate camera units track different subjects. Both optical systems within the same unit capture images of the same main subject from slightly different angles, ensuring consistent subject positioning information across both wide angle and telephoto stereo image pairs.

Inventive Principle:
Principle #5Merging (Combining)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables reliable capture of subjects on the optical axes of both telephoto systems, allowing for high-accuracy distance information calculation and focus adjustment, while maintaining subject tracking without deviation, even for moving subjects.

Implementation Method 1

a directivity sensor having a plurality of pixels that pupil-divide and selectively receive a light beam incident via the wide angle optical system and the telephoto optical system

Methodology Applied
Scientific EffectPupil division:

Implementation Method 2

The first imaging unit and the second imaging unit, which are disposed to be spaced from each other by the baseline length, can be rotationally moved in the horizontal direction and the vertical direction by the pan and tilt mechanism

Methodology Applied
Scientific EffectRotational motion:

Implementation Method 3

enabling accurate subject positioning and distance calculation using parallax analysis

Methodology Applied
Scientific EffectParallax: Parallax

Data Source

PatentEP3461127B1Stereo camera and stereo camera control method
Publication Date: 2024.03.06 FUJIFILM CORP
  • EP3461127B1 patent drawingFigure 1
  • EP3461127B1 patent drawingFigure 2
  • EP3461127B1 patent drawingFigure 3

AI summary

There are provided a stereo camera and a method of controlling a stereo camera capable of acquiring two wide angle images and two telephoto images at the same time and capable of reliably capturing a main subject on optical axes of two telephoto optical systems, particularly, in a case where the two telephoto images are acquired. A first wide angle image, a second wide angle image, a first telephoto image, and a second telephoto image are acquired from a first imaging unit 11L and a second imaging unit 11R at the same time, and particularly, optical axes of the wide angle optical system and the telephoto optical system constituting the first imaging optical system 12L match each other, and the second imaging optical system is similarly configured, and therefore, it is possible to position the main subject at a center position of the first telephoto image and the second telephoto image by independently performing pan and tilt control on the first imaging unit 11L and the second imaging unit 11R so that the main subject is captured on the respective optical axes of the first imaging optical system and the second imaging optical system on the basis of the first wide angle image and the second wide angle image.