XR App Interface Anchoring for Physical Object Focus
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
XR devices often display numerous virtual icons and elements that obscure physical objects and make it difficult to find relevant information, leading to potential hazards and inefficiencies in interaction with physical devices.
Innovation Solution
An XR device system predicts the user's focus on a physical object and positions relevant virtual elements near or on that object, using proximity, field of view, gaze detection, and user intent to ensure only relevant icons are displayed, anchored to a fixed location, and updated based on user interaction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If numerous virtual icons and elements are displayed on the XR device screen, then information availability is improved, but visual clutter increases and physical objects become obscured
Solution Approach 1:
The patent applies local quality by displaying different sets of virtual elements at different spatial locations corresponding to different physical objects. When the user focuses on a specific physical object, only the virtual elements associated with that object are displayed in its vicinity, while other virtual elements are hidden. This creates a localized information display strategy that reduces overall visual clutter while maintaining comprehensive information availability when needed.
2Ease of operation
If all application icons are displayed simultaneously, then application accessibility is improved, but user ability to locate relevant elements deteriorates
Solution Approach 1:
The patent implements dynamics by making the display of virtual elements dynamic and context-dependent rather than static. The system continuously monitors user focus (through gaze detection, head orientation, and proximity sensors) and dynamically adjusts which virtual elements are displayed. When the user looks at or approaches a physical object, the system dynamically reveals the relevant application icons near that object, making element location identification intuitive and effortless.
3Adaptability or versatility
If visual elements are positioned haphazardly on the XR display, then display flexibility is improved, but user expectation and locate time worsen
Solution Approach 1:
The patent applies dimensionality change by transitioning from a traditional 2D grid-based icon layout to a 3D spatial arrangement where virtual elements are positioned in relation to physical objects in the user's environment. Icons are anchored to specific locations in physical space and displayed at appropriate depths and orientations, creating a multi-dimensional interface that leverages the spatial capabilities of XR headsets to reduce locate time while maintaining display flexibility.
Data Source
AI summary
An extended reality (XR) device, for example, a head mounted device (HMD), may provide a visual element when the system determines that a wearer of the XR device is likely engaging with a physical device. This physical device is then set as the physical object of user focus. An application that is associated with the object of focus is identified and the XR device renders the visual element based on the associated application. The XR device may be caused to prevent displaying a graphical element generated by an application other than the associated application. The visual element may be rendered by the XR device at a fixed location anchored relative to the object of user focus.