Marker Detection Stability in Mixed Reality Positioning

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Marker-based position and orientation measurement in mixed reality applications becomes unstable due to varying marker sizes and visibility with user position, making it difficult for users to identify unstable areas.

Innovation Solution

An information processing apparatus with a first acquisition unit for marker arrangement and size information, a second acquisition unit for imaging apparatus data, and an unstable area derivation unit to identify areas where marker detection is unstable, outputting this information to notify users.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If marker-based position and orientation measurement is used in mixed reality applications, then the ability to calculate position and orientation is improved, but the stability of detection becomes poor when marker sizes and visibility vary with user position

Engineering Contradiction:
Improveposition and orientation measurement accuracyVSAvoidmarker detection stability
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The system performs preliminary calculation of unstable areas based on marker arrangement information and imaging apparatus parameters before the user actually experiences the mixed reality content. This advance computation allows the system to predict and prepare for detection instability issues, notifying users beforehand about areas where marker-based measurement may become unreliable.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces an intermediate computational layer that processes marker arrangement information and imaging apparatus parameters to generate unstable area maps. This intermediary processing step bridges the gap between static marker placement and dynamic user movement, providing a predictive model of detection stability without requiring real-time feedback during user interaction.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Area of stationary object

If markers are arranged to cover larger areas for better detection, then the detection coverage is improved, but the unstable areas where detection becomes unreliable expand as well

Engineering Contradiction:
Improvemarker detection coverage areaVSAvoiddetection stability in expanded areas
Core Design Contradiction:
Area of stationary objectVSReliability

Solution Approach 1:

The system segments the overall detection space into stable and unstable areas based on calculated parameters. By dividing the coverage area into distinct zones with different reliability characteristics, users can understand which portions of the expanded marker coverage are trustworthy for position and orientation measurement, allowing the system to provide broader coverage while maintaining reliability awareness.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS10068375B2Information processing apparatus, information processing method, and recording medium
Publication Date: 2018.09.04 CANON KK
  • US10068375B2 patent drawing
  • US10068375B2 patent drawing
  • US10068375B2 patent drawing

AI summary

To notify a user of an area where marker-based position and orientation measurement becomes unstable, an information processing apparatus according to the present specification includes, a first acquisition unit configured to acquire arrangement information and size information of a marker arranged in a real space, a second acquisition unit configured to acquire information about an imaging apparatus for capturing the real space, an unstable area derivation unit configured to derive an unstable area where the imaging apparatus is unable to stably detect the marker arranged in the real space, based on the arrangement information and the size information of the marker and the information about the imaging apparatus, and an output unit configured to output the area derived by the derivation unit.