Multi-Camera Calibration Location Optimization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing multi-camera systems face challenges in optimizing camera location for calibration, leading to suboptimal results due to trial-and-error methods and accumulation of errors in cascaded calibration processes.

Innovation Solution

An information processing device and method that acquires camera location information to evaluate and optimize the placement of a calibration camera within the imaging space, using evaluation indexes to determine the most accurate location for calibration, thereby avoiding trial-and-error and reducing error accumulation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If the reference camera method is used to calibrate cameras, then calibration can be performed between a reference camera and other imaging cameras, but the optimum location for calibration is not necessarily achieved for all camera pairs and requires trial-and-error by operators

Engineering Contradiction:
Improvecalibration accuracyVSAvoidoperation complexity
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The system pre-calculates and determines the optimal calibration camera location based on the positions and parameters of all imaging cameras before actual calibration occurs. This preliminary determination of calibration metrics and optimal positions eliminates the need for operator trial-and-error, directly resolving the contradiction between achieving high calibration accuracy and maintaining operational simplicity

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The invention introduces a calibration camera as an intermediary device that captures images of a calibration chart visible to multiple imaging cameras. This intermediary calibration camera serves as a common reference point for all imaging cameras, enabling accurate relative position calculation without requiring direct pairing calibration between each camera, thus simplifying the calibration process while maintaining high accuracy

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If the sequential method is used to calibrate cameras in a cascaded manner, then calibration can be performed between multiple cameras, but errors accumulate as a result of the cascaded calibration process

Engineering Contradiction:
Improvecalibration coverageVSAvoidcalibration accuracy
Core Design Contradiction:
Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The system merges all imaging camera data into a unified coordinate system by using the calibration camera as a common reference. Instead of cascaded calibration where each camera is calibrated relative to the previous one (causing error accumulation), all cameras are simultaneously calibrated relative to the same calibration camera, eliminating error propagation and maintaining high accuracy across the entire multi-camera system

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The calibration camera creates a common reference copy of the calibration chart that all imaging cameras can use to determine their relative positions. This copied reference image serves as a consistent baseline for all calibration calculations, preventing the error accumulation that occurs in sequential methods where each calibration step builds on potentially erroneous previous steps

Inventive Principle:
Principle #26Copying

3Measurement precision

If recalculation (bundle adjustment) is performed to distribute errors among cameras, then calibration accuracy may be improved, but the calculation cost becomes enormous

Engineering Contradiction:
Improvecalibration accuracyVSAvoidcalculation cost
Core Design Contradiction:
Measurement precisionVSUse of energy by stationary object

Solution Approach 1:

The system performs preliminary determination of calibration metrics and optimal calibration camera positions before actual calibration, based on the known positions and parameters of imaging cameras. This pre-calculation approach avoids the need for expensive bundle adjustment recalculation by establishing an optimal calibration setup that inherently minimizes errors, thus achieving high accuracy without enormous computational cost

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11165945B2Information processing device, method, and multi-camera system
Publication Date: 2021.11.02 SONY GROUP CORP
  • US11165945B2 patent drawing
  • US11165945B2 patent drawing
  • US11165945B2 patent drawing

AI summary

There is provided an information processing device including an information acquisition unit that acquires camera location information indicating locations of a plurality of imaging cameras located in an imaging space, and an evaluation unit that acquires calibration accuracy obtained in a case of locating a calibration camera in the imaging space on a basis of the location of each of the plurality of imaging cameras indicated by the camera location information and a location of the calibration camera.