Gaze-Based Virtual Object Alignment in Near-Eye Displays

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing near-eye devices struggle to accurately determine the distance of a gaze point for virtual and physical objects, leading to inaccuracies in aligning virtual presentation locations with physical objects in the user's environment.

Innovation Solution

An interaction method and apparatus that acquire gazing information for both virtual and physical objects, using electro-ocular data and image processing to determine differences within a set error range, allowing for precise alignment and adjustment of virtual presentation distances relative to physical objects.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If gazing information is acquired to determine virtual presentation distance, then alignment accuracy between virtual and physical objects is improved, but measurement precision of gazing distance is insufficient

Engineering Contradiction:

Improvegazing distance measurement precisionVSAvoidvirtual object positioning precision

Core Design Contradiction:

Measurement precisionVSManufacturing precision

Solution Approach 1:

The patent applies feedback by acquiring the user's gazing information and using it to adjust the virtual presentation distance. The system measures the gazing distance, compares it with the actual distance to the physical object, and adjusts the virtual object's position based on the difference, creating a closed-loop control system that improves alignment accuracy.

Inventive Principle:

Principle #23Feedback

Solution Approach 2:

The patent replaces traditional mechanical or manual methods of determining virtual object position with an optical-electrical system that uses eye tracking technology. Instead of manual adjustment or fixed positioning, the system uses electro-ocular instruments to detect gazing direction and distance, converting biological signals into positional data for accurate virtual object placement.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

2Adaptability or versatility

If transmissive near-eye device is used to present virtual objects, then presentation capability is improved, but accuracy in determining gazing point distance deteriorates

Engineering Contradiction:

Improvevirtual presentation capabilityVSAvoidgazing point distance determination accuracy

Core Design Contradiction:

Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The patent introduces an intermediary measurement system that works in conjunction with the transmissive near-eye device. Instead of relying solely on the device's native capabilities, it uses additional electro-ocular instruments as intermediaries to measure gazing distance and direction, providing supplementary data that compensates for the limitations of the transmissive display system.

Inventive Principle:

Principle #24Intermediary (Mediator)

Data Source

PatentUS10108259B2Interaction method, interaction apparatus and user equipment

Publication Date: 2018.10.23 BEIJING ZHIGU RUI TUO TECH

AI summary

Embodiments of this application disclose an interaction method, an interaction apparatus and a user equipment, where the interaction method comprises: acquiring first gazing information of at least one eye of a user when watching a virtual presentation object on a location in a gazing direction, and second gazing information of the at least one eye of the user when watching a physical object on the location in the gazing direction; and in response to that a difference between the first gazing information and the second gazing information is out of a set error range, executing an operation. In the embodiments of this application, a presentation location of the virtual presentation object may be associated with a location of the physical object in an environment accurately and conveniently by means of gazing of the user.