Camera Position Estimation via Automatic Map Collation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for estimating the position and orientation of an image capturing apparatus in mixed reality applications are time-consuming, especially when switching between different environments or situations, as they require extensive preliminary work and user intervention to select appropriate map information.

Innovation Solution

An apparatus that generates map information including feature points and identification indices, collates this information with registered data, and estimates the camera's position and orientation using a combination of marker and feature point data, allowing for rapid selection of suitable map information and improved alignment accuracy.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If map information is selected by user operation from a displayed list, then appropriate map information can be selected, but the time required increases due to frequent operations

Engineering Contradiction:
Improvemap information selection accuracyVSAvoidtime for map information selection
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system automatically performs map information selection by comparing identification information from captured images with registered map data, eliminating the need for manual user selection operations while maintaining accurate map matching

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system pre-registers multiple map information pieces with identification information during preliminary work, enabling rapid automatic selection during actual use without requiring user intervention at runtime

Inventive Principle:
Principle #10Preliminary action

2Adaptability or versatility

If alignment processing is performed at different places or times, then adaptability to various environments is improved, but the time required to check and select map information increases

Engineering Contradiction:
Improveenvironmental adaptabilityVSAvoidtime for map information verification
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

The system automatically determines the most appropriate map information by comparing identification information from the current environment with registered maps, eliminating manual verification time while maintaining adaptability across different locations and times

Inventive Principle:
Principle #25Self-service

3Loss of information

If file size of map information increases, then more detailed information is available, but the time to identify and select the appropriate map increases proportionally

Engineering Contradiction:
Improvemap information completenessVSAvoidtime for map identification
Core Design Contradiction:
Loss of informationVSLoss of time

Solution Approach 1:

The system extracts and uses only the critical identification information (such as marker patterns or feature point configurations) from map data for rapid comparison and selection, separating this key identification data from the full map file to enable fast matching without processing entire large files

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentUS11967107B2Information processing apparatus and method of estimating position and orientation of image capturing apparatus
Publication Date: 2024.04.23 CANON KK
  • US11967107B2 patent drawing
  • US11967107B2 patent drawing
  • US11967107B2 patent drawing

AI summary

An apparatus includes a generation unit configured to generate map information including a position of a feature point and identification information on an index in an image of a real space captured by a capturing apparatus, a collation unit configured to collate the identification information on the index in the generated map information with the identification information on the index in one or more pieces of registered map information, and to extract map information from the one or more pieces of registered map information based on a result of the collation, and an estimation unit configured to estimate a position and orientation of the capturing apparatus based on the position of the feature point in the extracted map information and the position of the feature point in the generated map information.