Mixed Reality Marker Tracking for Stable Virtual Object Alignment

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing mixed reality devices face challenges in maintaining accurate display positions of virtual objects relative to real-world objects as the objects are moved, leading to potential confusion and errors in task execution.

Innovation Solution

A mixed reality device that sets an origin for a virtual space using a marker in real space, displays virtual objects at preset positions in a three-dimensional coordinate system, and adjusts the origin based on the movement amount of the marker relative to a reference position, ensuring accurate display alignment even when objects are moved.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If the origin of virtual space is fixed using a marker, then the virtual object can be displayed at a preset position, but the display position becomes inaccurate when the marker moves

Engineering Contradiction:
Improvedisplay position accuracyVSAvoidresponse to marker movement
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The patent applies dynamics by making the origin movable instead of fixed. The origin is dynamically adjusted based on the marker's movement amount, allowing the virtual space coordinate system to adapt to the marker's new position while maintaining display accuracy. This resolves the contradiction by enabling the system to respond to movement while preserving precision.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent implements feedback by continuously monitoring the marker's position and using this information to adjust the origin. The movement amount calculation provides feedback about the marker's displacement, which is then used to correct the origin position, creating a closed-loop system that maintains accuracy despite movement.

Inventive Principle:
Principle #23Feedback

2Measurement precision

If the origin is moved frequently to track marker movement, then display accuracy is maintained, but system stability deteriorates due to continuous adjustments

Engineering Contradiction:
Improvedisplay position accuracyVSAvoidcoordinate system stability
Core Design Contradiction:
Measurement precisionVSStability of the object's composition

Solution Approach 1:

The patent applies preliminary anti-action by predicting and compensating for origin shifts before they cause display errors. By calculating the movement amount in advance and adjusting the origin proactively, the system prevents display inaccuracies from occurring in the first place, rather than reacting after errors appear.

Inventive Principle:
Principle #9Preliminary anti-action

Solution Approach 2:

The patent implements preliminary action by pre-calculating the origin adjustment based on marker movement. The system determines the required origin shift before redisplaying the virtual object, ensuring that the coordinate system is already corrected when the object is rendered, thus maintaining both accuracy and stability.

Inventive Principle:
Principle #10Preliminary action

3Measurement precision

If complex calculations are performed to maintain display accuracy during marker movement, then position precision is improved, but computational complexity increases

Engineering Contradiction:
Improvedisplay position accuracyVSAvoidcalculation complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent extracts only the essential calculation needed for origin adjustment - the movement amount between frames. By focusing solely on calculating the displacement vector rather than performing full coordinate transformations, the system maintains accuracy while significantly reducing computational complexity.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent changes the calculation approach by working with movement amounts (deltas) rather than absolute positions. This parameter transformation simplifies the mathematics from full coordinate system transformations to simple vector additions, reducing computational burden while preserving precision.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS20250124669A1Mixed reality device, processing method, and storage medium
Publication Date: 2025.04.17 KK TOSHIBA
  • US20250124669A1 patent drawing
  • US20250124669A1 patent drawing
  • US20250124669A1 patent drawing

AI summary

According to one embodiment, a mixed reality device is configured to set an origin of a virtual space by using a marker located in a real space. The mixed reality device is configured to display a virtual object at a preset position in a three-dimensional coordinate system, the three-dimensional coordinate system being based on the origin. The mixed reality device is configured to acquire a movement amount of the marker with respect to a reference position of the marker. The reference position of the marker being acquired when the origin is set. The mixed reality device is configured to move the origin according to the movement amount when the movement amount is greater than a first threshold, the first threshold being preset.