Gaze and Gesture Control for External Display Targeting
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Controlling electronic devices with remote controls can be more difficult than desired, particularly for devices with displays such as televisions.
Innovation Solution
An electronic device equipped with sensors, communication circuitry, and processors that enable gaze and gesture inputs to control external devices by determining the location of a display using cameras and transmitting this information along with gesture inputs to the external device.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If remote controls are used to control electronic devices with displays, then device control functionality is achieved, but ease of operation deteriorates
Solution Approach 1:
The patent replaces the mechanical remote control system with an optical-based gaze tracking system. Cameras capture eye movement and head position data, which is then processed to determine user intent for controlling display content. This substitution eliminates the need for physical remote controls and their associated buttons, dials, and switches, thereby improving ease of operation while maintaining control functionality.
Solution Approach 2:
The patent introduces an intermediary processing system that translates natural human behaviors (gaze direction, head movement) into control commands. This intermediary layer includes image processing circuitry that captures sensor data, determines gaze points on the display, and generates corresponding control signals. This mediator enables intuitive control without requiring users to interact with complex remote control interfaces.
2Ease of operation
If multiple input methods are integrated for device control, then ease of operation improves, but device complexity increases
Solution Approach 1:
The patent merges multiple sensing capabilities (eye movement detection, head position tracking, gesture recognition) into a unified control system. These previously separate input methods are integrated to work together, allowing the system to determine user intent through combined analysis of gaze direction, head orientation, and hand gestures. This merging provides comprehensive control capabilities while managing system complexity through integrated processing.
Solution Approach 2:
The patent creates a universal control system that can interpret multiple types of user inputs (gaze, head movement, gestures) through a single integrated platform. The image processing circuitry and control signal generation are designed to handle diverse input types uniformly, enabling one system to perform multiple control functions. This multi-functionality improves ease of operation by providing flexible input options without proportionally increasing perceived complexity for the user.
Data Source
AI summary
An electronic device may be used to control an external electronic device. Camera images may be used to determine a location of a display associated with the external electronic device relative to the electronic device. Camera images may also be used to identify a gaze direction of the user and gesture inputs from a user. The gaze direction and the location of the display relative to the electronic device may be used to determine a location on the display that is targeted by the user's gaze. The electronic device may transmit the identified gesture input and/or the determined location on the display that is targeted by the user's gaze to the external electronic device to control the external electronic device.