AR Control Object Summoning With Multi-Factor Intention Detection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing augmented reality (AR) systems struggle to accurately determine user intentions for controlling digital objects, leading to premature removal or improper positioning of control objects, which can distract users and degrade their experience.
Innovation Solution
Implement multi-factor intention determination using a set of simultaneous indications such as palm-facing gestures, eye gaze, head gaze, and finger position to summon and position control objects like menus or keyboards in AR environments, ensuring they remain docked and visible when intended by the user.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If single-factor intention determination is used for control object activation, then system complexity is reduced, but intention detection accuracy deteriorates leading to premature removal or improper positioning of control objects
Solution Approach 1:
The patent combines multiple indication factors (eye gaze, hand gestures, head position) into a unified intention determination system. The control object activation requires concurrence of multiple factors rather than relying on a single factor, thereby improving detection accuracy while managing system complexity through integrated processing.
Solution Approach 2:
The patent introduces an intermediary processing layer that receives multiple indication signals and determines user intention based on their combination. This intermediary layer acts as a mediator between raw sensor data and control object activation, enabling accurate intention detection without directly increasing overall system complexity.
2Object-affected harmful factors
If control objects are automatically removed when user attention shifts, then visual clutter is reduced, but user experience deteriorates due to premature removal before intended use
Solution Approach 1:
The patent implements preliminary verification by requiring multiple indication factors to confirm user intention before activating or removing control objects. This preliminary action prevents premature removal by verifying that the user truly intends to dismiss the control object through multiple correlated signals.
Solution Approach 2:
The system continuously monitors multiple indication factors and provides feedback on control object visibility based on real-time user attention and intent assessment. This feedback mechanism ensures control objects remain visible when needed while being removed when appropriate, balancing visual clarity with usability.
3Speed
If control objects are positioned based on limited user input, then system responsiveness is improved, but positioning accuracy deteriorates causing distracting or suboptimal placement
Solution Approach 1:
The patent merges multiple positioning indications (eye gaze direction, hand gesture target, head orientation) to determine control object placement. By combining these multiple spatial indicators, the system achieves accurate positioning while maintaining responsive activation through the integrated processing of concurrent signals.
Data Source
Figure 1
Figure 2~3
Figure 4
AI summary
Examples of augmented reality (AR) environment control advantageously employ multi-factor intention determination and include: performing a multi-factor intention determination for summoning a control object (e.g., a menu, a keyboard, or an input panel) using a set of indications in an AR environment, the set of indications comprising a plurality of indications (e.g., two or more of a palm-facing gesture, an eye gaze, a head gaze, and a finger position simultaneously); and based on at least the set of indications indicating a summoning request by a user, displaying the control object in a position proximate to the user in the AR environment (e.g., docked to a hand of the user). Some examples continue displaying the control object while at least one indication remains, and continue displaying the control object during a timer period if one of the indications is lost.