Gaze Tracking Device Controllable Device Selection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In large industrial environments with numerous devices, users wearing gaze tracking devices face difficulty in precisely selecting and controlling distant or clustered devices due to the extensive field of view, leading to inefficiencies in device control.
Innovation Solution
The system enhances augmented reality technology by allowing users to select a target region within their field of view, providing a magnified, augmented reality representation of controllable devices, enabling easier selection and control through eye tracking and hand gestures, with machine learning algorithms to suggest relevant devices based on user behavior and environmental parameters.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If users control devices directly in a large industrial environment with numerous devices, then device control functionality is provided, but users face difficulty in precisely selecting and controlling distant or clustered devices due to the extensive field of view
Solution Approach 1:
The system segments the extensive field of view into multiple controllable regions. Users can select specific regions of interest within the large field of view, and the system renders magnified representations of devices within those selected regions. This segmentation allows users to focus on specific areas containing distant or clustered devices, making precise selection and control possible without being overwhelmed by the entire extensive field of view.
2Loss of information
If the system renders all devices in the field of view, then complete device information is provided, but the complexity of managing multiple devices increases
Solution Approach 1:
The system extracts and highlights only the devices relevant to the user's current focus within the selected region of interest. Instead of rendering all devices in the extensive field of view simultaneously, the system identifies and extracts devices within the magnified region, rendering them with enhanced visibility and control options. This extraction approach maintains information completeness for devices in the selected region while reducing the apparent complexity by not displaying all devices at full detail.
3Ease of operation
If users manually select devices in a large field of view, then device selection is possible, but time is lost due to the extensive area to search
Solution Approach 1:
The system implements dynamic region selection where users can quickly define regions of interest by simple gestures or eye tracking, and the system dynamically adjusts the magnified view to follow the user's attention. This dynamic approach allows users to rapidly shift focus between different areas containing devices without manual searching, significantly reducing the time required to locate and select specific devices in the extensive field of view.
Data Source
AI summary
Provided are a computer program product, system, and method for rendering information in a gaze tracking device on controllable devices in a field of view to remotely control. A determination is made of a field of view from the gaze tracking device of a user based on a user position. Devices are determined in the field of view the user is capable of remotely controlling to render in the gaze tracking device. An augmented reality representation of information on the determined devices is rendered in a view of the gaze tracking device. User controls are received to remotely control a target device comprising one of the determined devices for which information is rendered in the gaze tracking device. The received user controls are transmitted to the target device to control the target device.