AR Virtual Object Positioning via Visual Field Tracking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In augmented reality applications, users face inconvenience when trying to maintain virtual objects within their visual field during physical activities, as they need to manually reposition these objects, limiting the use of AR products as alternatives to mobile devices for providing audio and visual instructions.

Innovation Solution

A display method and system that uses a processor to recognize characteristics of a main object in a video, determine a target point, calculate position relationships, and control a display device to dynamically position a virtual object in a virtual environment, ensuring it remains visible to the user without manual adjustment.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Stability of the object's composition

If the virtual display screen stays at a fixed position in reference to the real scene, then it can simulate a real display device, but the user has to manually reposition it when it leaves the visual field during physical activities

Engineering Contradiction:
Improvevirtual object position stabilityVSAvoidmanual repositioning operation
Core Design Contradiction:
Stability of the object's compositionVSEase of operation

Solution Approach 1:

The patent applies dynamics by transitioning the virtual display screen from a static fixed position to a dynamic position that automatically adjusts based on user movement and visual field conditions. The system continuously tracks user position and orientation, then dynamically repositions the virtual screen to maintain visibility during physical activities, eliminating manual repositioning while preserving the simulation of a real display device.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system implements self-service by enabling the virtual display screen to automatically reposition itself without user intervention. The processor monitors user visual field status and autonomously adjusts the virtual screen's position and orientation to keep it within the visual field during physical activities, making the system self-adjusting and convenient for users.

Inventive Principle:
Principle #25Self-service

2Ease of operation

If the virtual display screen is manually repositioned by the user, then it can remain in the visual field, but this causes inconvenience during physical activities

Engineering Contradiction:
Improvevirtual object visibilityVSAvoidtime for repositioning operation
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The system applies preliminary action by continuously monitoring user position and visual field conditions in advance, before the virtual display screen leaves the visual field. The processor predicts when repositioning will be needed and proactively adjusts the virtual screen's position, preventing it from leaving the visual field in the first place. This eliminates the need for reactive manual repositioning and saves user time during physical activities.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent implements feedback by creating a closed-loop system where the processor continuously receives data about user position and visual field status, processes this information, and automatically adjusts the virtual display screen's position accordingly. This real-time feedback mechanism ensures the virtual screen remains visible during physical activities without requiring manual intervention, reducing both inconvenience and time loss.

Inventive Principle:
Principle #23Feedback

3Adaptability or versatility

If the virtual display screen remains fixed, then the system is simple to operate, but AR products cannot effectively replace mobile devices for providing audio and visual instructions

Engineering Contradiction:
ImproveAR product functionalityVSAvoidautomatic positioning system
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent applies universality by designing a positioning system that serves multiple functions: it tracks user position, monitors visual field status, determines orientation, and automatically repositions the virtual display screen. This multi-functional system enables AR products to effectively replace mobile devices for providing audio and visual instructions during physical activities, enhancing adaptability without requiring separate systems for each function.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system replaces manual mechanical repositioning operations with an automated electronic control system. The processor uses sensor data and computational algorithms to automatically adjust the virtual display screen's position, substituting the mechanical action of manual dragging and dropping with an electronic automated positioning mechanism. This reduces device complexity perception while significantly improving AR product functionality and versatility.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS11682136B2Display method, display system and non-transitory computer readable storage medium
Publication Date: 2023.06.20 HTC CORP
  • US11682136B2 patent drawing
  • US11682136B2 patent drawing
  • US11682136B2 patent drawing

AI summary

A display method for displaying a virtual object, comprising: by at least one processor, recognizing characteristics of a main object from a video; by the at least one processor, recognizing a first fixed object from the video; by the at least one processor, determining a first target point in the video according to the characteristics of the main object; by the at least one processor, calculating a first position relationship between the first fixed object and the first target point; by the at least one processor, determining an anchor point in a virtual environment; and by the at least one processor, controlling a display device to display the virtual object at a second target point in the virtual environment by setting a second position relationship corresponding to the first position relationship between the anchor point and the second target point.