Human-Machine Interface With Gaze-Based AR Launcher Navigation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing human-machine interaction systems face issues with ergonomics, reliability, and resource intensity, particularly in virtual and augmented reality environments, limiting intuitive and precise user interactions and efficient data sharing.
Innovation Solution
A human-machine interface system with a visual interaction device that captures the real environment, tracks user gaze, and provides a launcher with navigable graphical elements on the floor, allowing intuitive function execution through gaze-based navigation and contextual content adaptation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If traditional interaction devices are used in VR/AR systems, then basic interaction functions are provided, but ergonomics are poor and user movements cannot be performed in an intuitive and precise manner
Solution Approach 1:
The patent replaces traditional mechanical interaction devices (controllers, joysticks) with a gaze-based interaction system. The interface detects the user's gaze direction and uses it to navigate and select options in the virtual environment, substituting manual mechanical control with optical detection of eye movements. This provides more intuitive and ergonomic interaction while maintaining precision through gaze tracking algorithms.
2Reliability
If existing interaction systems are used, then user interaction is enabled, but reliability depends enormously on the external actual environment
Solution Approach 1:
The patent implements a dynamic interface that adapts to the user's gaze movements in real-time. The interface elements move and reposition themselves based on where the user is looking, creating a responsive interaction system that maintains reliability across different environmental conditions. The system dynamically adjusts to user behavior rather than requiring perfect environmental conditions.
3Productivity
If known interaction solutions are used for remote collaboration, then basic connectivity is provided, but efficient dynamic evolution of the displayed virtual environment is not allowed
Solution Approach 1:
The patent creates a universal gaze-based interaction interface that can be used across multiple applications and remote collaboration scenarios. The same gaze tracking mechanism serves multiple functions: navigation, selection, scrolling through options, and triggering actions. This multi-functional approach enables efficient dynamic evolution of virtual environments without requiring separate complex systems for each function.
4Productivity
If existing interaction systems are used, then basic functions are provided, but computing resources are too resource-intensive with inefficient and/or unreliable results
Solution Approach 1:
The patent extracts the core interaction function from complex traditional systems and implements it through a streamlined gaze-based interface. By taking out only the essential interaction capability (gaze detection and response) and eliminating unnecessary complexity, the system achieves better computing efficiency while maintaining or improving reliability of interaction results.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enhances ergonomics and reliability by enabling intuitive and precise user interactions with reduced computing resources, while facilitating efficient data sharing and dynamic virtual environment adaptation.
Implementation Method 1
The interaction device (DI) capturing the real environment of the user in order to provide it to the interface, which generates a mesh of the environment
Implementation Method 2
the interface, which generates a mesh of the environment and tracks the user's gaze
Data Source
AI summary
A human-machine interface system includes at least one visual interaction device having image-capturing means and display means and computerized means executing an interface allowing a user to interact with the visual interaction device. The system presenting the user with an at least partially virtual content item, in particular, for augmented reality, the interaction device capturing the real environment of the user to provide it to the interface, which generates a mesh of the environment and tracks the user's gaze, the interface being configured to detect when the user's gaze is oriented toward the ground and to start a launcher that is presented to the user via the interaction device in the form of at least one navigation content item including a plurality of graphical elements that the user is able to scroll through with their gaze and that are representative of a function to which they correspond.