Bounding Virtual Object for AR Proximity Feedback
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In augmented reality systems, users often find it difficult to determine when their hand is close to a virtual object, leading to unintentional or missed interactions, especially for inexperienced users, due to the lack of clear visual cues and haptic feedback.
Innovation Solution
A head-mounted display system that includes a processor configured to display a bounding virtual object when the user's hand is within a certain distance of a world-locked virtual object, with the bounding object's appearance changing based on the distance and interacting with the hand, providing visual cues for proximity and interaction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If no bounding visual indicator is displayed, then the device complexity is reduced, but the user awareness of hand proximity to virtual objects deteriorates
Solution Approach 1:
The patent introduces a bounding visual indicator as an intermediary element between the user's hand and the virtual object. This indicator serves as a mediator that communicates proximity information to the user without requiring complex system changes. The bounding indicator is a simple graphical overlay that appears when the hand approaches within a threshold distance, providing clear visual feedback while maintaining system simplicity.
2Ease of operation
If a bounding virtual object is displayed to indicate proximity, then the user awareness of hand proximity improves, but the device complexity increases
Solution Approach 1:
The patent employs color changes in the bounding visual indicator to convey different proximity states and interaction opportunities. The bounding indicator may change color based on distance thresholds, such as showing one color when the hand is far away and another color when close to the virtual object. This use of color variation provides intuitive visual feedback without requiring complex interface elements, thereby improving ease of operation while limiting the increase in device complexity.
3Ease of operation
If visual feedback is provided through bounding objects, then the ease of operation improves, but the loss of time for processing and displaying additional graphics increases
Solution Approach 1:
The patent implements preliminary action by pre-defining distance thresholds and corresponding bounding indicator states. The system calculates the distance between the hand and virtual object once per frame, and based on pre-established threshold values, determines which bounding state to display. This approach avoids complex real-time calculations and allows for efficient rendering, as the decision logic is simplified to comparing current distance against predetermined thresholds, thereby reducing processing time while maintaining ease of operation.
Data Source
AI summary
A head-mounted display system is provided, including a head-mounted display, an imaging sensor, and a processor. The processor may convey instructions to the head-mounted display to display a virtual object at a world-locked location in a physical environment. The processor may receive imaging data of the physical environment from the imaging sensor. The processor may determine, based on the imaging data, that a world-space distance between a hand of a user and the world-locked location is below a predetermined distance threshold. The processor may convey instructions to the head-mounted display to display a bounding virtual object that covers at least a portion of the virtual object. The processor may detect, based on the imaging data, a change in the world-space distance. The processor may convey instructions to the head-mounted display to modify a visual appearance of the bounding virtual object based on the change in the world-space distance.