Dynamic Reference Data Update for Imaging Position Tracking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for measuring the position and orientation of an imaging apparatus, such as in mixed reality systems, lose accuracy and stability when the imaging apparatus moves out of the predefined range of virtual points of view.

Innovation Solution

An information processing device that holds reference data including captured images, positions, orientations, and three-dimensional feature information, allowing for the derivation of the imaging apparatus's position and orientation, and dynamically updates this data by generating and adding new reference data based on input images and three-dimensional information.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If virtual points of view are arranged in a predefined range for position and orientation measurement, then measurement accuracy is maintained within the range, but measurement reliability deteriorates when the imaging apparatus moves beyond the predefined range

Engineering Contradiction:
Improveposition and orientation measurement accuracyVSAvoidmeasurement stability
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The system dynamically generates new virtual points of view based on the actual position and orientation of the imaging apparatus. Instead of using a static predefined set of virtual points, the system adapts the virtual points of view to follow the imaging apparatus movement, ensuring that measurement accuracy is maintained regardless of the apparatus position in the physical space.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system performs preliminary generation of new reference data including new captured images and new three-dimensional maps before measurement accuracy deteriorates. By proactively expanding the virtual points of view based on predicted or current imaging apparatus positions, the system ensures continuous measurement reliability without waiting for accuracy degradation to occur.

Inventive Principle:
Principle #10Preliminary action

2Device complexity

If a static three-dimensional map with fixed virtual points of view is used, then device complexity is reduced, but adaptability deteriorates when the imaging apparatus moves to new locations

Engineering Contradiction:
Improvereference data structureVSAvoidrange of measurement coverage
Core Design Contradiction:
Device complexityVSAdaptability or versatility

Solution Approach 1:

The three-dimensional map and virtual points of view are transformed from static to dynamic structures. The system automatically generates new three-dimensional maps and updates existing ones as the imaging apparatus moves to new locations, allowing the reference data to adapt to expanding measurement ranges without requiring manual reconfiguration.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system performs self-updating of the three-dimensional map and virtual points of view based on newly captured images and detected feature points. When the imaging apparatus moves beyond the current reference data range, the system autonomously generates new reference data without external intervention, maintaining both simplicity and adaptability.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS10643347B2Device for measuring position and orientation of imaging apparatus and method therefor
Publication Date: 2020.05.05 CANON KK
  • US10643347B2 patent drawing
  • US10643347B2 patent drawing
  • US10643347B2 patent drawing

AI summary

An information processing device includes a holding unit which holds pieces of reference data including a captured image, a position and an orientation of an imaging apparatus when the image is captured, and three-dimensional information of a feature in a space corresponding to the image in association with each other, an input unit which inputs the captured image, a derivation unit which derives a position and an orientation of the imaging apparatus when the input image is captured, an addition determination unit which determines whether a new piece of reference data is to be added, a generating unit which, if the addition determination unit determines the new piece of reference data is to be added, generates a new piece of reference data, and an updating unit which adds the generated piece of reference data and updates the pieces of reference data.