3D Virtual Interface Gaze Routing System
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current computing systems are limited by the physical constraints of their displays and touch screens, restricting the interaction and display of user interfaces, especially in three-dimensional environments.
Innovation Solution
The system facilitates the display and interaction with user interfaces in a three-dimensional environment by capturing a real-world environment, presenting a computer-generated environment with virtual affordances, and allowing input selection to switch between different user interfaces based on user gaze direction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If a physical display or touch screen is used for user interaction, then the user interface can be displayed and interacted with, but the interaction is limited by the physical constraints of the display
Solution Approach 1:
The patent extends the two-dimensional display into a three-dimensional virtual environment. The user interface is projected into a virtual space that can be viewed and interacted with from multiple angles, transforming the flat display experience into an immersive spatial interface that overcomes physical display limitations.
Solution Approach 2:
The system introduces a camera as an intermediary device to capture the physical display and transform it into a virtual representation. This intermediary enables the physical display content to be recontextualized within a three-dimensional environment, allowing new interaction modalities without modifying the original display hardware.
2Loss of information
If multiple user interfaces are displayed on a single physical display, then more information can be accessed, but the display area is limited
Solution Approach 1:
Multiple user interfaces are arranged in a three-dimensional virtual space rather than competing for two-dimensional screen real estate. Users can navigate through different interface layers and perspectives, effectively displaying more information without increasing the physical display area by utilizing the depth and spatial dimensions of the virtual environment.
3Ease of operation
If gaze direction is used to control input routing, then hands-free operation is enabled, but gaze detection accuracy is required
Solution Approach 1:
The system provides visual feedback by highlighting or indicating which user interface element is currently selected based on gaze direction. This feedback loop allows users to verify that their gaze is being correctly interpreted and adjust their gaze position accordingly, compensating for potential inaccuracies in gaze detection through continuous visual confirmation.
Data Source
AI summary
Some examples of the disclosure are directed to systems and methods for displaying and interacting with a representation of a user interface of an electronic device in a three-dimensional environment. While presenting a first user interface, a first electronic device presents a representation of a second user interface of a second electronic device based on display data representing the second user interface. In response to detecting a respective event corresponding to user input, if a gaze of a user of the first electronic device is directed to the representation of the second user interface, the first electronic device causes the second electronic device to perform a first operation directed to the second user interface based on the respective event. Alternatively, if the gaze is directed to the first user interface, the first electronic device performs a second operation directed to the first user interface based on the respective event.