AR Control Object Docking with Multi-Factor Intention Detection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing augmented reality (AR) systems struggle to accurately determine user intentions for control object placement, leading to premature removal or positioning conflicts, which degrade the user experience.
Innovation Solution
Implement multi-factor intention determination using a set of indications, including palm-facing gestures, eye and head gazes, and finger positions, to summon and position control objects like menus or keyboards in AR environments, ensuring they remain docked and visible even when the user's gaze or position changes.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If a control object is displayed in AR environment based on simple user input detection, then the system response speed is improved, but the accuracy of understanding user intention deteriorates
Solution Approach 1:
The patent combines multiple indication sources (eye tracking, head tracking, hand tracking, voice commands) into a unified intention determination system. By merging these different input modalities, the system achieves more accurate user intention detection while maintaining responsive performance, as the combinations provide more reliable signals than individual inputs alone.
Solution Approach 2:
The system implements feedback mechanisms where the AR system monitors multiple user indicators simultaneously and adjusts control object display based on the combined feedback. This multi-factor feedback approach allows the system to accurately determine user intention by analyzing patterns across multiple input streams, resolving the contradiction between speed and accuracy.
2Adaptability or versatility
If control objects are positioned dynamically based on user gaze, then the adaptability to user needs is improved, but the stability of control object position deteriorates
Solution Approach 1:
The patent implements dynamic positioning where control objects automatically adjust their position based on real-time detection of user eye gaze and head orientation. The system continuously monitors user indicators and repositions control objects to remain within the user's field of view, enhancing adaptability while maintaining stability through smooth transition algorithms and threshold-based activation.
3Object-affected harmful factors
If control objects are removed when user gaze shifts away, then the distraction to user is reduced, but the loss of useful information display deteriorates
Solution Approach 1:
The system employs periodic monitoring of user eye gaze and head position with defined thresholds and time windows. Instead of immediate removal upon single gaze shift, the system uses periodic detection cycles with hysteresis thresholds, only removing control objects when multiple consecutive measurements confirm the user has deliberately shifted attention away, thereby reducing false removals while still minimizing distraction.
Data Source
AI summary
Examples of augmented reality (AR) environment control advantageously employ multi-factor intention determination and include: performing a multi-factor intention determination for summoning a control object (e.g., a menu, a keyboard, or an input panel) using a set of indications in an AR environment, the set of indications comprising a plurality of indications (e.g., two or more of a palm-facing gesture, an eye gaze, a head gaze, and a finger position simultaneously); and based on at least the set of indications indicating a summoning request by a user, displaying the control object in a position proximate to the user in the AR environment (e.g., docked to a hand of the user). Some examples continue displaying the control object while at least one indication remains, and continue displaying the control object during a timer period if one of the indications is lost.