AR Wearable UI Repositioning Around Controller Occlusion
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional wearable electronic devices, such as AR glasses and VST devices, face challenges in efficiently displaying virtual objects due to fixed positioning that can be obstructed by the user's hand or controller, leading to poor usability during interactions.
Innovation Solution
The wearable electronic device dynamically adjusts the display position of virtual objects based on the use and position of controllers, synchronizing with the controller's position when in use and changing positions when not in use or placed on the ground, ensuring clear visibility.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If the virtual object is displayed in a fixed position, then the display system is simple and stable, but the virtual object may be obstructed by the user's hand or controller leading to poor usability
Solution Approach 1:
The display position of the virtual object is changed from fixed to dynamic, allowing it to move according to the controller's position. This enables the virtual object to avoid obstruction by the user's hand or controller during interactions, improving usability while maintaining system stability through automated position adjustment based on sensor data.
2Reliability
If the virtual object position synchronizes with the controller position, then visibility during interaction is improved, but the system complexity increases due to continuous position tracking
Solution Approach 1:
The system uses sensor data from the controller to continuously feedback the controller's position to the display system. This feedback loop enables the virtual object to synchronize its position with the controller, ensuring consistent visibility during interactions while managing system complexity through efficient data processing and rendering optimization.
3Ease of operation
If the virtual object is repositioned dynamically, then obstruction by hands or controllers is prevented, but the rendering performance and processing load increase
Solution Approach 1:
The system implements dynamic repositioning of virtual objects selectively, adjusting positions based on interaction states and obstruction detection. Rather than continuously repositioning all virtual objects, the system applies position changes only when necessary (when obstruction is detected or during active interaction), reducing unnecessary processing energy while maintaining clear visibility during critical moments.
Data Source
AI summary
A wearable electronic device comprises, a memory storing instructions, a camera, a communication circuit, a display, and at least one processor, wherein the wearable electronic device is configured to, display, a virtual first object indicating a user interface in a first area, identify whether the first controller is in use, identify whether a first condition for setting that a display position of the virtual first object is linked to the position of the first controller is satisfied, display the virtual first object on a second area corresponding to the position of the first controller, the display position of the virtual first object being changed according to a changed position of the first controller when the position of the first controller is changed, display the virtual first object in a third area corresponding to the position of the first controller identified through the camera, and based on identifying that the first condition is not satisfied while the first controller is in use, maintain the display position of the virtual first object in the first area.