Camera Calibration Using Integrated Pattern Markers

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for estimating camera parameters, such as position and orientation, are inefficient and require repetitive processes involving multiple markers and extensive imaging, making high-accuracy calibration of multiple cameras challenging.

Innovation Solution

An information processing apparatus with an acquisition unit for synchronized images, a detection unit for image patterns, and a determination unit to calculate camera parameters, allowing for accurate estimation of camera positions and orientations using a smaller number of markers and efficient image processing.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If multiple markers are used for camera parameter estimation, then measurement precision is improved, but device complexity and loss of time increase due to repetitive imaging processes

Engineering Contradiction:
Improvecamera parameter estimation accuracyVSAvoidtime for repetitive imaging processes
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent combines multiple markers into a single integrated marker structure that contains multiple identifiable features. This single marker can be captured in one imaging operation, eliminating the need for repetitive imaging processes while still providing sufficient data for accurate camera parameter estimation through feature detection and matching algorithms

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The marker is designed with pre-defined image patterns and features that are optimized for detection. The marker structure is prepared in advance with specific geometric arrangements that enable accurate parameter estimation from a single capture, eliminating the need for multiple imaging steps

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If multiple markers are used for camera parameter estimation, then measurement precision is improved, but device complexity increases due to multiple markers and extensive imaging requirements

Engineering Contradiction:
Improvecamera parameter estimation accuracyVSAvoidcomplexity of multiple markers and imaging system
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent merges the functionality of multiple separate markers into a single marker structure that contains multiple detectable features. This reduces the physical number of markers from multiple to one, simplifying the overall system while maintaining the computational complexity needed for accurate parameter estimation through feature detection and matching

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The single marker structure is designed to serve multiple functions simultaneously: it provides multiple identifiable features for detection, establishes spatial relationships for calibration, and works across different imaging conditions. This multi-functional design eliminates the need for multiple specialized markers

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Measurement precision

If repetitive imaging processes are performed for marker detection, then measurement precision is improved, but productivity decreases due to time-consuming calibration

Engineering Contradiction:
Improvecamera parameter estimation accuracyVSAvoidcalibration efficiency
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The marker is designed with pre-arranged image patterns and geometric features that are optimized for single-shot detection. The spatial arrangement of features within the marker is carefully planned to provide sufficient information for accurate parameter estimation from one capture, eliminating the need for repetitive imaging to gather adequate data

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11514606B2Information processing apparatus, information processing method, and non-transitory computer-readable storage medium
Publication Date: 2022.11.29 CANON KK
  • US11514606B2 patent drawing
  • US11514606B2 patent drawing
  • US11514606B2 patent drawing

AI summary

An information processing apparatus acquires a plurality of captured images captured by a plurality of image capturing devices, the plurality of captured images having imaging time codes that match each other, the plurality of captured images being used for generating a virtual viewpoint image, executes a detection process for detecting a predetermined image pattern on the plurality of captured images, and determines parameters on positions of the plurality of image capturing devices and orientations from the plurality of image capturing devices based on a result of the detection process for detecting the predetermined image pattern on the plurality of captured images having the imaging time codes that match each other.