Mixed Reality Position Estimation Using Segmented Search Ranges

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for measuring the position and orientation of an image sensing device in mixed reality systems face challenges, particularly when dealing with complex objects and environments where measurement line segments overlap, leading to incorrect edge correspondence and erroneous position and orientation estimation.

Innovation Solution

The technique involves projecting a virtual object onto the sensed image, setting search ranges for each side of the virtual object based on its positional relationship, searching for edges within these ranges, and calculating the position and orientation relationship between the virtual and physical objects using the correspondence between the projected sides and detected edges.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If measurement line segments with high density are used for arbitrary measurement target objects, then the application range is widened, but search areas overlap causing erroneous edge correspondence

Engineering Contradiction:
Improveapplication rangeVSAvoidedge correspondence accuracy
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The patent divides the search area into multiple sub-regions based on the spatial distribution of measurement line segments. By segmenting the search space and assigning specific sub-regions to individual line segments, the method prevents overlapping searches and ensures that each edge is correctly associated with its corresponding line segment, thereby maintaining reliability while handling high-density arbitrary objects.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies different search strategies to different regions of the image based on local characteristics. For areas where measurement line segments are densely distributed, restricted search areas are imposed, while other regions may use more flexible search methods. This local adaptation allows the system to maintain accuracy in critical overlapping regions while preserving versatility for various object types.

Inventive Principle:
Principle #3Local quality

2Ease of manufacture

If search areas for all measurement line segments are processed independently, then the method is simple to implement, but process redundancy occurs reducing productivity

Engineering Contradiction:
Improveimplementation simplicityVSAvoidprocessing efficiency
Core Design Contradiction:
Ease of manufactureVSProductivity

Solution Approach 1:

The patent merges the search processes for multiple measurement line segments by identifying and combining overlapping search areas. Instead of independently processing each line segment's search area, the method consolidates redundant search regions into single processing units, thereby reducing computational redundancy while maintaining the simplicity of the overall approach.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent introduces dynamic adjustment of search areas based on the spatial relationships between measurement line segments. The search region for each line segment is dynamically restricted to exclude areas already covered by other segments, creating an adaptive processing scheme that reduces redundancy while preserving implementation simplicity through automated region management.

Inventive Principle:
Principle #15Dynamics

3Quantity of substance

If the distance between measurement line segments is small, then more segments can be used for complex objects, but search areas overlap with high probability

Engineering Contradiction:
Improvenumber of measurement line segmentsVSAvoidsearch area distinctness
Core Design Contradiction:
Quantity of substanceVSReliability

Solution Approach 1:

The patent performs preliminary arrangement of search areas before the actual edge detection process. By pre-calculating and assigning distinct search regions to each measurement line segment based on their spatial relationships, the method ensures that even when line segments are densely distributed, their search areas remain distinct and non-overlapping, thereby maintaining reliability while allowing use of numerous segments.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS7911503B2Information processing apparatus and information processing method
Publication Date: 2011.03.22 CANON KK
  • US7911503B2 patent drawing
  • US7911503B2 patent drawing
  • US7911503B2 patent drawing

AI summary

A measurement line segment projection unit (400) projects, onto a sensed image, a three-dimensional model which is arranged at the position and orientation of a physical object (199). A search range is set for each side of the virtual object projected onto the sensed image, near the side of the virtual object in the sensed image based on a positional relationship between the side and other sides of the virtual object. A side of the physical object (199) on the sensed image is searched for within the search range for each side of the virtual object. The position and orientation relationship between the physical object (199) and an image sensing device (50) is calculated using the correspondence relationship, determined based on the search result, between each side of the three-dimensional model projected onto the sensed image and each side of the physical object (199) located on the sensed image.