Line-of-Sight Interface Display for Efficient XR Interaction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing extended reality (XR) devices face inefficiencies in processing interfaces such as shortcut menus and pop-up windows due to their fixed display positions, leading to missed interactions and low processing efficiency.
Innovation Solution
The method involves detecting a user's line-of-sight position during the display of a target image and associating the interface with this position, allowing timely and efficient viewing by displaying the interface at the user's line-of-sight.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If interfaces are displayed at fixed positions (e.g., top of screen), then device operation simplicity is maintained, but interface processing efficiency deteriorates due to missed interactions and low viewing efficiency
Solution Approach 1:
The patent applies dynamics by transitioning from fixed-position interface display to dynamic line-of-sight-based display. The interface position changes according to the user's real-time line-of-sight direction, making the display location adaptive and dynamic rather than static. This resolves the contradiction by maintaining operational simplicity through natural gaze-based interaction while dramatically improving interface processing efficiency through timely visibility.
Solution Approach 2:
The patent changes the display position parameter from a fixed coordinate to a variable determined by line-of-sight detection. By using eye-tracking technology to detect the user's gaze direction and calculating the corresponding position on the display screen, the interface is rendered at a location that dynamically adapts to user attention, thereby improving viewing efficiency without complicating the interaction model.
2Productivity
If interfaces are displayed at fixed positions, then display system simplicity is maintained, but interface viewing efficiency deteriorates due to delayed user perception
Solution Approach 1:
The patent replaces traditional mechanical or manual interface positioning methods with an optical-based line-of-sight detection system. By using eye-tracking technology to detect gaze direction and automatically positioning interfaces accordingly, the system eliminates the need for manual adjustment or fixed positioning mechanisms, thereby improving viewing efficiency while the added complexity is confined to the detection and calculation subsystems.
Solution Approach 2:
The patent implements a feedback loop where the system continuously detects the user's line-of-sight position, calculates the appropriate display location, and renders the interface accordingly. This real-time feedback mechanism ensures the interface appears exactly where the user is looking, dramatically improving viewing efficiency. The feedback-based approach manages complexity by automating the positioning decision-making process rather than requiring complex manual control systems.
3Measurement precision
If interfaces are displayed away from user line-of-sight, then display layout simplicity is maintained, but interaction accuracy deteriorates due to missed or delayed interactions
Solution Approach 1:
The patent replaces traditional mechanical interaction methods (such as physical buttons or manual navigation) with an optical line-of-sight detection system. By using eye-tracking technology to precisely measure where the user is looking and positioning the interface at that location, the system achieves high interaction accuracy. The complexity of line-of-sight detection is offset by the elimination of complex manual interaction mechanisms.
Solution Approach 2:
The patent enables the display system to automatically position interfaces based on detected line-of-sight without requiring user intervention or complex control inputs. The system serves itself by using its own detection capabilities to optimize interface placement, thereby improving interaction accuracy while managing complexity through automation rather than requiring complex user-operated positioning systems.
Data Source
AI summary
An embodiment of the present disclosure provides an interface display method, apparatus, device and medium. The interface display method includes: detecting an interface triggering action during a process of displaying a target image by a virtual terminal device; in response to the interface triggering action, determining a target interface that needs to be displayed; detecting a first line-of-sight position corresponding to a line-of-sight of a user in the target image; displaying the target interface at the first line-of-sight position of the target image. By detecting the user's actions and line-of-sight, the display and control of the interface are triggered to solve the problem of low efficiency of interface processing for the extended reality scenario.