Gaze-Based Mixed Reality Content Placement in 3D Space
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current mixed reality (MR) head-mounted displays (HMDs) face challenges in controlling the display of MR content due to limited optical capabilities, requiring multiple steps and hardware restrictions, and lack a natural and quick way to place content on focally accurate viewing planes, especially in 3D space, leading to user discomfort and inefficiency.
Innovation Solution
A gaze-based system that uses a vision guideline implemented as an MR object, guiding the user's gaze to focus on focally correct viewing distances, allowing the system to determine the location and dimensions of content enhancement based on hardware restrictions and surrounding objects, enabling quick and natural control of MR content placement.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If multiple modalities and gestures are used to control MR objects, then control precision is improved, but operation complexity increases
Solution Approach 1:
The patent combines head direction control with hand gesture manipulation into a unified interaction framework. The head direction determines the target object and activation point, while hand gestures execute the manipulation, merging spatial selection and object control into a coordinated system that reduces the number of separate interaction modalities needed.
Solution Approach 2:
The patent introduces an intermediary selection mechanism where head direction first selects a target object or activation point, which then enables subsequent hand gesture control. This intermediary step acts as a mediator between gaze-based selection and manual manipulation, allowing precise control without requiring complex simultaneous multi-modal input.
2Measurement precision
If hand gestures are used to manipulate MR objects, then manipulation precision is improved, but user comfort deteriorates
Solution Approach 1:
The patent replaces purely manual mechanical gestures with a hybrid system that uses head direction (a more natural, less fatiguing action) to determine target and activation, reducing the mechanical burden on the user's hands while maintaining manipulation precision through coordinated hand movements when needed.
3Measurement precision
If multiple interaction steps are required to move an object, then control accuracy is improved, but interaction time increases
Solution Approach 1:
The patent performs preliminary selection of the target object and activation point through head direction before the user commits to a manipulation gesture. This preliminary action pre-establishes the control parameters, so when the user performs the hand gesture, the object is already positioned and configured for immediate manipulation, reducing the number of sequential steps required.
4Ease of operation
If gaze-based control is used, then ease of operation is improved, but control precision deteriorates
Solution Approach 1:
The patent merges gaze-based target selection with hand gesture-based manipulation execution. The gaze (head direction) provides easy, natural target acquisition and activation point selection, while hand gestures provide precise control for object manipulation, combining the advantages of both input modalities into a coordinated system.
Data Source
AI summary
Systems and methods are presented for discovering and positioning content into augmented reality space. A method includes forming a three-dimensional (3D) map of surroundings of a user of an augmented reality (AR) head mounted display (HMD); determining a depth-wise location of a gaze point of a user based on eye gaze direction and eye vergence; determining a visual guidance line pathway in the 3D map: guiding an action of the user along the visual guidance line pathway at one or more identified focal points; and rendering a mixed reality (MR) object along the visual guidance line pathway at a location corresponding to a direction of the user's gaze.