Gaze-Based Remote Control via Unified Interface Adaptation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Users face inconvenience in controlling multiple electronic devices as they often require navigating different user interfaces and using multiple remote control transmitters, which can be cumbersome and inefficient.
Innovation Solution
A system that allows users to control electronic devices intuitively by detecting their gaze direction, adapting the user interface accordingly, and transmitting control signals to the selected device, using a combination of environment imaging, gaze detection, and natural user input systems.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If users control multiple electronic devices using traditional remote controls and navigation methods, then each device can be controlled reliably, but the operation complexity and time required increase significantly
Solution Approach 1:
The system employs a single controller device that can control multiple different electronic devices (TV, audio system, game console, etc.) through a unified gaze-based interface, eliminating the need for multiple device-specific remote controls and simplifying the control paradigm across diverse devices
Solution Approach 2:
The patent replaces traditional mechanical remote control operations (button pressing, directional navigation) with a gaze-based selection system where the user simply looks at the desired device or interface element, and the system automatically detects and selects it, dramatically reducing physical interaction complexity
2Adaptability or versatility
If users navigate different user interfaces on each device, then each device's specific functions can be accessed, but the time and complexity of control operations increase
Solution Approach 1:
The system performs preliminary actions by automatically detecting which device the user is looking at and pre-loading or pre-positioning the relevant control interface elements before the user actually needs to interact with them, reducing wait time and navigation steps
Solution Approach 2:
The controller device serves as an intermediary that presents a unified interface to the user while handling the complexity of communicating with multiple different devices, translating user intent into device-specific commands without requiring the user to learn multiple interfaces
3Adaptability or versatility
If users keep several remote-control transmitters on hand, then control of different devices is possible, but the device complexity and user burden increase
Solution Approach 1:
The system merges the functionality of multiple separate remote controls into a single controller device that can communicate with multiple different electronic devices, consolidating what would otherwise require several separate transmitters into one unified tool
Solution Approach 2:
The controller device is designed with universal functionality to control various types of devices (TV, audio, gaming, etc.) through gaze detection and a standardized interface, making it unnecessary for users to maintain a collection of device-specific remotes
Data Source
Figure 1
Figure 2
Figure 3
AI summary
Embodiments are disclosed that relate to gaze-based remote device control. For example, one disclosed embodiment provides, on a computing device, a method comprising detecting a gaze direction of a user, detecting an indication from the user to control a remotely controllable device located in the gaze direction, and adapting a user interface of a controller device to enable user control of the remotely controllable device.