Stereo Camera Self-Calibration for Dynamic Lens Position Accuracy

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Stereo cameras face accuracy degradation due to environmental influences, mechanical changes, and aging, which affect the zoom and pan/tilt mechanisms, leading to inconsistent three-dimensional measurement and imaging performance.

Innovation Solution

A stereo camera system that dynamically estimates and updates camera parameters through self-calibration, using a camera control unit, calibration unit, and image recognition unit to maintain accuracy by adjusting for changes in lens position, orientation, and other settings without the need for external calibration charts.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If a stereo camera uses zoom lenses and pan/tilt mechanisms to control imaging parameters, then the angle of view and field of view can be adjusted, but the camera parameters deviate from factory settings due to environmental influences and mechanical changes

Engineering Contradiction:
Improveadjustability of angle of view and field of viewVSAvoidaccuracy of three-dimensional measurement
Core Design Contradiction:
Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The system performs self-calibration by detecting feature points in captured images and calculating camera parameters (focal length, principal point, distortion coefficients) based on the relationship between captured images and three-dimensional coordinates of calibration objects. This feedback mechanism continuously corrects deviations in camera parameters caused by environmental influences and mechanical changes, maintaining measurement accuracy while allowing zoom and pan/tilt adjustments.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The stereo camera performs automatic self-calibration without requiring external calibration charts or manual intervention. The calibration process uses naturally present feature points in the imaging range to automatically update camera parameters, enabling the system to self-correct for mechanical drift and environmental effects while maintaining operational versatility.

Inventive Principle:
Principle #25Self-service

2Measurement precision

If the camera performs three-dimensional measurement based on imaging information from multiple cameras, then depth information can be obtained, but accuracy deteriorates when mounting errors occur due to vibration or housing expansion/contraction

Engineering Contradiction:
Improvedepth measurement accuracyVSAvoidrelative position stability of multiple cameras
Core Design Contradiction:
Measurement precisionVSStability of the object's composition

Solution Approach 1:

The system performs self-calibration for each camera individually by detecting feature points and calculating extrinsic parameters (position and orientation) and intrinsic parameters (focal length, distortion) based on the relationship between captured images and known three-dimensional coordinates. This feedback process continuously corrects for mounting errors, vibration effects, and housing dimensional changes, maintaining accurate depth measurement despite physical instability.

Inventive Principle:
Principle #23Feedback

3Ease of operation

If the camera settings are changed during operation (zooming, panning, tilting), then the field of view can be adjusted, but frame-out occurs and measurement accuracy degrades

Engineering Contradiction:
Improveability to change camera settingsVSAvoidconsistency of three-dimensional measurement
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The system performs dynamic self-calibration that adapts to changing camera settings during operation. When zoom, pan, or tilt parameters change, the calibration unit automatically updates camera parameters by detecting feature points in the new field of view and recalculating the relationship between image coordinates and three-dimensional space. This dynamic adaptation maintains measurement consistency throughout operational changes without causing frame-out issues.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS10652521B2Stereo camera and image pickup system
Publication Date: 2020.05.12 HITACHI LTD
  • US10652521B2 patent drawing
  • US10652521B2 patent drawing
  • US10652521B2 patent drawing

AI summary

Provided is an imaging system such as a stereo camera which includes a mechanism capable of controlling a camera setting such as zooming or panning/tilting, wherein the stereo camera and the imaging system maintains measurement accuracy of the imaging system even when the camera setting is changed. The stereo camera including at least two cameras estimates camera parameters of the camera when a lens position of the camera is changed by an operation instruction of the camera. In addition, the imaging system includes at least two cameras, a camera control unit which controls at least a lens position of the camera, a calibration unit which estimates camera parameters of the camera when at least the lens position of the camera is moved by the camera control unit, and an image recognition unit which performs three-dimensional restoration of captured images of the cameras based on the camera parameters.