Virtual Image Display Positioning via Inertial Tracking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current virtual image display systems face challenges in enhancing the display effect of virtual object images, particularly in maintaining accurate positioning and direction adjustments when the identification pattern is not visible.

Innovation Solution

A virtual image display system and method that uses a handheld electronic device to display an identification pattern, which is photographed by a virtual image display to adjust the position and direction of the object image. When the pattern disappears, inertial measurement information from the device is captured to continue adjusting the image's position and direction, ensuring improved display performance.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If the system relies solely on photographing the identification pattern to adjust object image position and direction, then the display effect is improved when the pattern is visible, but the system fails to maintain accurate positioning when the pattern disappears

Engineering Contradiction:
Improvepositioning accuracyVSAvoiddisplay continuity
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The patent introduces inertial measurement units (IMUs) as intermediary devices that continuously track device motion and orientation. When the identification pattern is visible, the system uses image recognition to determine position and direction. When the pattern disappears, the IMU data serves as an intermediary mechanism to maintain positioning and orientation information, ensuring continuous and accurate display without relying solely on visual patterns.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent implements continuous tracking by combining identification pattern recognition with inertial measurement. The system maintains continuous positioning and orientation data through IMU sensors that operate regardless of pattern visibility. This ensures the object image position and direction are continuously adjusted based on device movement, eliminating gaps in tracking when the pattern is not visible.

Inventive Principle:
Principle #20Continuity of useful action

2Ease of operation

If the system uses identification pattern recognition to control object image position and direction, then the display effect is enhanced, but the system cannot maintain positioning when the pattern is not visible

Engineering Contradiction:
Improvedisplay performanceVSAvoidpositioning reliability
Core Design Contradiction:
Ease of operationVSAdaptability or versatility

Solution Approach 1:

The patent makes the positioning system universal by integrating multiple functions: identification pattern recognition for initial positioning, inertial measurement units for continuous motion tracking, and fusion of both methods for robust positioning. This multi-functional approach allows the system to adapt to various scenarios whether the pattern is visible or not, improving both display performance and positioning reliability.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system implements feedback mechanisms where IMU data continuously provides feedback on device orientation and movement. This feedback loop ensures the object image position and direction are continuously adjusted according to actual device posture, maintaining accurate display performance even when the identification pattern is not visible.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS11748965B2Virtual image display system and virtual image display method
Publication Date: 2023.09.05 HTC CORP
  • US11748965B2 patent drawing
  • US11748965B2 patent drawing
  • US11748965B2 patent drawing

AI summary

A virtual image display system and a virtual image display method are provided. The virtual image display method includes: displaying, by a handheld electronic device, an identification pattern, where the identification pattern corresponds to an object image; photographing, by a virtual image display, the identification pattern and displaying the object image according to the identification pattern; and capturing, by the virtual image display, inertial measurement information of the handheld electronic device when the identification pattern disappears and adjusting at least one of a position and a direction of the object image according to the inertial measurement information.